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5 

6 BACKGROUND OF THE INVENTION 

7 Field of the Invention 

8 [1 003] The present invention relates to user interfaces in general and more 

9 specifically to a user interface for an ultrasound imaging device and to a handheld 
10 ultrasound imaging device. 

11 

1 2 Description of Prior Art 

1 3 [1004] Ultrasonic imaging is a fi-equently used method of analysis for isxamining a 

14 wide range of materials. Ultrasonic imaging is especially common in medicine because 

15 of its relatively non-invasive nature, low cost and fast response times. Typically, 

16 ultrasonic imaging is accomplished by generating and directing ultrasonic sound waves 

17 (an ultrasonic beam or signal) into a medium under investigation using a set of ultrasound . 

1 8 generating transducers and then observing reflections generated at the boundaries of 

19 dissimilar materials, such as tissues within a patient, also using a set of ultrasound 

20 receiving transducers. A single transducer, however, may be used rather than an array of 

21 transducers. The receiving and generating transducers may be arranged in arrays and the 

22 same transducer may be used for both receiving and generating ultrasonic signals. The 

23 reflections are converted to electrical signals by the receiving transducers and then 
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1 processed, using techniques known in the art, to determine the locations of echo sources. 

2 The resulting data is displayed using a display device, such as a monitor. 

3 [1005] Typically, the ultrasonic signal transmitted into the medium under 

4 investigation is generated by applying continuous or pulsed electronic signals to an 

5 ultrasound generating transducer. The transmitted ultrasonic signal is most commonly in 

6 the range of 40 kHz to 30 MHz. The ultrasonic signal propagates through the medium 

7 under investigation and reflects off interfaces, such as boundaries, between adjacent 

8 tissue layers. Scattering of the ultrasonic signal is the deflection of the ultrasonic signal 

9 in random directions. Attenuation of the ultrasonic signal occurs when some of the 

10 ultrasonic signal is lost while the signal travels. Reflection of the ultrasonic signal is the 

1 1 bouncing off of the ultrasonic signal from an object and changing its direction of travel. 

12 Transmission of the ultrasonic signal is the passing of the ultrasonic signal through a 

13 medium. As it travels, the ultrasonic signal is scattered, attenuated, reflected, and/or 

14 transmitted. The portions of the reflected ultrasonic signals that return to the transducers 

15 are detected as echoes. The detecting transducers convert the echo signals into electronic 

16 signals and, after amplification and digitization, furnish these ultrasonic signals to a beam 

17 former. The beam former calculates locations of echo sources and typically includes 

18 simple filters and signal averagers. After beam forming, the calculated positional 

19 information is used to generate two-dimensional data that can be presented as an image. 

20 [1006] As an ultrasonic signal propagates through a medium under investigation, 

21 additional harmonic frequency components are generated. These components are 

22 analyzed and associated with the visualization of boundaries or image contrast agents 

23 designed to re-radiate ultrasonic signals at specific harmonic frequencies. Unwanted 
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1 reflections within the ultrasound device can cause noise and the appearance of artifacts 

2 (i.e., image features that result from the imaging system and not from the medium under 

3 investigation) in the image. Artifacts may obscure the imderlying image of the medium 

4 under investigation. 

5 [1007] The ultrasonic signal intensity as a function of position may oscillate rather 

6 than fall off monotonically as a function of distance from the center of the beam that 

7 forms the ultrasonic signal. These oscillations in ultrasonic signal intensity are often 

8 called "side lobes." hi the prior art, the term "apodisation" refers to the process of 

9 affecting the distribution of ultrasonic signal intensity to reduce side lobes. In the 

10 remainder of this specification, however, the term "apodisation" is used to refer to 

1 1 tailoring the distribution of ultrasonic signal intensity for a desired beam characteristic 

12 such as having a Guassian or sine function (without the side lobes) distribution of 

13 ultrasonic signal intensity. 

14 [1008] Steering refers to changing the direction of an ultrasonic signal. Aperture 

1 5 refers to the size of the transducer or group of transducers being used to transmit or 

16 receive an ultrasonic signal. 

1 7 [1 009] The prior art process of producing, receiving and analyzing an ultrasonic 

18 . signal (or beam) is called beam forming. The production of ultrasonic sijgnals optionally 

19 includes apodisation, steering, focusing and aperture control. Using a prior art data 

20 analysis technique, each ultrasonic signal is used to generate a one-dimensional set of 

21 echolocation data. In a typical implementation, a plurality of ultrasonic beams is used to 

22 scan a multi-dimensional volume. Imaging, in general, and ultrasound imaging, in 

23 particular, are utilized in many medical procedures in order to detect a patient's 
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1 condition. For example, ultrasonic imaging is commonly used to detect and monitor the 

2 growth and health of fetuses or to detect and assist in the diagnosis of liver and kidney 

3 pathology. 

4 [1010] Many medical ultrasound imaging systems have been designed, manufactured 

5 and successfully used, each varying in presentation, complexity, and ergonomics. In 

6 some cases, the user interfaces are cumbersome to operate. Even more cumbersome are 

7 those user interfaces requiring two hands to operate or transport resulting in encumbrance 

8 of using the system for real-time examinations. Other examples of difficulties that arise 

9 in the case of a handheld device are navigation and selection of the user interface items 
10. using one hand or one thumb. It may be desirable, in handheld ultrasound devices, the 

1 1 user interface allow for quick and efficient interaction supported by intelligent user 

12 interface behavior, context sensitivity, data dependent optimization and the ability to self- 

1 3 adapt to user behavior. 

14 [1011] Further, as medical services tend to be expensive, the easier a medical 

15 professional can operate the user interface, the. more patients the medical professional can 

16 serve and the less the medical professional will need to charge for their services. 
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1 SUMMARY OF THE INVENTION 

2 [1012] The present user interface may include an intelligent and/or dynamic graphical 

3 user interface together with a set of tactile controls. The user interface provides several 

4 types of graphical elements with intelligent behavior. For example, the graphical element 

5 may be a context sensitive and adaptive element such as an active object. Active objects 

6 of the present user interface may be tabs, menus, icons, windows for user interaction and 

7 data display and/or an alphanumeric keyboard, for example. In addition the user 

8 interface may be voice activated. The user interface may include a touch screen for direct 

9 selection of displayed active objects. In an embodiment, the functions of the ultrasound 

10 system are organized into operational modes that allow for a menu structure that is 

1 1 intuitive to the user so that the user spends less time looking for features and more time 

12 using the ultrasoimd system in comparison to a menu structure that is not intuitive to the 

13 user. 

14 [1013] In an embodiment, the ultrasound system is a handheld device. A limited set 

15 of hard and soft keys with adaptive ftmctionality allow for one hand, and potentially one 

16 thumb operation. Elements are considered "active" when they have their own 

17 information processing capabiUties, for example, each icon, tab or selection may have a 

18 response that is a function of input, context, and/or history. Elements are considered 

19 "intelligent" when the interactions between elements, the user, and the device are auto- 

20 adaptive (i.e., auto-adaptive interactions are automatically optimized depending on a 

21 number of parameters, including system state, and/or user habits, for example). In order 

22 to accommodate holding and controlling the device at the same time with one hand, the 
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1 user interface maybe designed for one-hand, one-thumb operation and makes use of 

2 several intelligent (adaptive and context sensitive) and/or active elements (e.g., windows, 

3 soft buttons, tabs, menus, toolbars, and icons). For example, the buttons may be placed 

4 on the handle of the handheld ultrasound system so they can be operated using the thumb 

5 of the hand holding the display portion of the handheld ultrasound system. The number 

6 and functions of the buttons indicated in this invention are for exemplification purposes 

7 and shall not constitute a limitation of the invention. Some buttons have fixed 

8 functionality (hard buttons); i.e., they always activate the same system function 

9 independent of the operation mode such as a button for fi-eezing and unfreezing an image 

10 or a button for automatically optimizing display parameters. In an embodiment, other 

1 1 buttons are used to position a cursor on the graphical user interface up, down, left, and 

12 right. A select button may be used to activate an object to which a cursor is pointing to or 

13 to perform a certain system function in accordance with the cursor's position. In an 

14 embodiment, one or more buttons may switch functionality depending on the system state 

15 of ultrasound system and/or may be programmable, such as a print/save and/or a 

1 6 back/escape button. In an embodiment the buttons may be placed on a handle of a 

17 display screen so that they can be activated while holding the display screen. The buttons 

18 may be designed for use with a specific finger (e.g., the thumb) or with a specific set of 

19 fingers. The buttons should not be significantly smaller than the width of the finger (e.g., 

20 the thumb) for which they are designed to be used. The buttons should also not be too 

21 much wider, than the intended finger or fingers for which they are designed so as not to 

22 unduly limit number of buttons on the handle. For example, the buttons may be .25 to 

23 2.5 cm wide. The buttons may be arranged in a circular or elliptical pattern so that they 



7 



1 are easily accessible. In an embodiment buttons may have the functions that are most 

2 frequently used. 

3 [1014] The imaging device of the invention may provide for a microphone (and/or an 

4 input for an external microphone) and a loudspeaker (and/or an output for external 

5 loudspeakers). The user can train the device to recognize a set of words or combinations 

6 of words. Each recognizable unit (word or word combination) can be assigned to a 

7 device command, performing a specific function or a sequence of functions, so that the 

8 user has the option of operating part of or all of the ultrasound system by voice, thereby 

9 requiring less use of hands to operate. 

10 [1015] In an embodiment, an auto-optimize button is provided. Whenever the user 

1 1 ' presses this button, the system settings are automatically optimized in accordance with 

12 several parameters including the system state, the image content, and the type of 

13 application. 

14 [1016] In an embodiment, the screen of the ultrasound device may be shared by 

15 several elements each of which may be active and/or intelligent, which may facilitate 

16 one-hand, one-thumb controlled imaging. For example, the tabs on the top left hand side 

17 of the screen representation can be selected by using the left/right buttons. The entries on 

1 8 one tab can be selected by using the up/down buttons. The icons on the toolbar on the 

19 bottom right-hand side of the screen can be selected by using the left/right buttons. A 

20 select/back button may be provided having multiple functions including that of the enter 

21 button on a keyboard. The image window is itself an active element. Changing input 

22 focus (i.e., the region sensitive to input) from the tab on the left hand side to the image on 

23 the right hand side can be achieved by using a combination of lefl/right or selectAjack. 
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1 buttons. All the text fields on the right hand side image window, e.g., the 'Tati^^ 

2 or the "Date and Time" fields, are active elements. These active elements can be selected 

3 . using the left/right or select/back buttons, for example, and once selected, show active 

4 and/or intelligent behavior. For example, selecting the "Date and Time" field may 

5 automatically fill the "Date and Time" field with the date and time. Similarly, selecting 

6 the "Patient Name" can open the database interface and retrieve the corresponding patient 

7 record. 

8 [1017] In an embodiment, one-handed, potentially one-thumb alphanumeric data 

9 entry (e.g., patient name and/or other patient information) may be achieved by displaying 

10 a "virtual" keyboard. The user can select any alphanumeric key on the keyboard by using 

1 1 the left/right and up/down buttons. Using these buttons will have the same effect as 

1 2 depressing a keyboard key. 

13 [1018] Other screens may also be configured to optimize one-hand and/or one-thumb 

14 operations. The database interface is configured such that database fields are selectable 

15 using the left/right and up/down buttons. The file navigation interface has a hierarchical 

16 structure that provides for up/down navigation at the same level in the hierarchy and 

17 left/right navigation to move between hierarchy levels. The same concept appHes to all 

18 hierarchically structured active elements. 

19 [1019] In order to support the user in learning and operating the system, context 

20 sensitive help is provided. This context sensitive help may relate to explaining the 

21 fiinctional capabilities of the system or to the interpretation of image data, for example. 

22 [1020] In an embodiment, the user interface provides for random access to any of the 

23 active elements through a touchscreen. In the one-handed embodiment, the user can 
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1 utilize the thumb or any other finger to "touch" and activate any of the screen elements. 

2 In addition, a stylus, or another pointing device, can be used in a two-handed operation 

3 mode. 

4 [1021] In an embodiment, in order to minimize the time for setting up and 

5 configuring the system the user interface may provide for application and/or user 

6 dependent presets, which are optimized based on several factors (e.g., user behavior, 

7 image quality, etc.). In an embodiment, several active elements are introduced in 

8 accordance with this invention in order to minimize user interaction for achieving 

9 predefined goals. For example, the icon "Full Screen Image" allows the user to directly 

10 switch to an imaging mode where the image occupies the fiiU screen. The "Full Screen 

1 1 Image" display mode introduced in this invention is preferred because it shows the user a 

12 bigger image, where the details are easier to distinguish. 

13 [1022] Regarding the ultrasound imaging system of the invention, broad beam 

14 technologies refer t6 systems and methods that include or take advantage of techniques 

15 for generating ultrasound and analyzing detected echoes. Broad beam technologies use 

16 multidimensional spatial information obtainable from a single ultrasonic pulse. 

17 [1023] Area forming is the process of producing, receiving, and analyzing an 

18 ultrasonic beam, that optionally includes apodisation, steering, focusing, and aperture , 

19 control, where a two-dimensional set of echolocation data can be generated using only 

20 one ultrasonic beam. Nonetheless, more than one ultrasonic beam may still be used with 

21 the area forming even though only one is necessary. Area forming is a process separate 

22 and distinct from beam forming. Area forming may yield an area of information one 

23 transmit and/or receive cycle, in contrast to beam forming that typically only processes a 
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1 line of information per transmit and/or receive cycle. Alternatively, beam forming can be 

2 used instead of area forming electronics throughout this application. 

3 [1024] Volume forming is the process of producing, receiving, and analyzing an 

4 ultrasonic beam, that optionally includes apodisation, steering, focusing, and aperture 

5 control, where a three dimensional set of echolocation data can be generated using only 

6 one ultrasonic beam. Nonetheless, multiple ultrasonic beams may be used although not 

7 necessary. Volume forming is a superset of area forming. 

8 [1025] Multidimensional forming is the process of producing, receiving, and 

9 analyzing an ultrasonic beam that optionally includes apodisation, steering, focusing, and 

10 aperture control. Using multidimentional forming a two or more dimensional set of 

1 1 spatial echolocation data can be generated with only one ultrasonic beam. Nonetheless, 

12 multiple ultrasonic beams may be used although not necessary. Multidimensional 

13 forming optionally includes non-spatial, dimensions such as time and velocity. 

1 4 [1026] The Graphical User Literface (GUI) of the present invention can be used with 

15 a system that makes use of broad beam technologies. 
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1 BRIEF DESCRIPTION OF THE DRAWINGS 

2 [1027] FIG. 1 shows a block diagram of an ultrasound system according to an 

3 embodiment of the invention; 

4 [1028] FIG. 2 shows a diagram of the contents of the memory of the ultrasound 

5 system of FIG. 1; 

6 [1029] FIG. 3 shows the main operational modes of the ultrasound system; 

7 [1030] FIG. 4 shows the system configuration mode of the ultrasound system; 

8 [1 031 ] " FIG. 5 shows the patient information mode of the ultrasound system; 

9 [1032] FIG. 6 shows the mode selection mode of the ultrasound system; 

10 [1033] FIG. 7 shows the B-mode of the ultrasound system; 

1 1 [1034] FIG. 8 shows the color flow mode of the ultrasound system; 

12 [1035] FIG. 9 shows the power Doppler mode of the ultrasound system; 

13 [1036] FIG. 10 shows the Pulsed Wave (PW) Doppler mode of the ultrasound system; 

14 [1037] FIG. 1 1 shows the Continuous Wave (CW) Doppler mode of the ultrasound 

15 system; 

16 [1038] FIG. 12 shows the M-mode of the ultrasound system; 

17 [1039] FIG. 13 shows the fireeze mode of the ultrasound system; 

1 8 [1040] FIG. 14 shows the measure mode of the ultrasound system; 

19 [1041] . FIG. 15 shows the measure and annotate mode of the ultrasound system; 

20 [1042] FIG. 16 shows the calculation mode of the ultrasound system; 

21 [1043] FIG. 17 shows the reporting mode of the ultrasound system; 

22 [1044] FIG. 18 shows the system services mode of the ultrasound system; 
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1 [1045] FIG. 19 shows an overview of an embodiment of the ultrasound system; 

2 [1046] FIG. 20 shows an operation mode of an embodiment of the ultrasoxmd system; 

3 [1047] FIG. 21 shows buttons on the display and control unit of the ultrasoxmd 

4 system; ^ 

5 [1048] FIG. 22 shows an example of a menu tree according to the invention; 
. 6 [1049] FIG. 23 shows an embodiment of a main display screen; 

7 [1050] FIG. 24 shows an embodiment of the main display screen; 

8 [1051] FIG. 25 shows a view having a color flow control panel; 

9 [1052] FIG. 26 A shows a view having a PW Doppler control panel; 

10 [1053] FIG. 26 B shows a view having a CW Doppler control panel; 

1 1 [1054] FIG. 26 C shows a view having maps tab selected; 

12 [1055] FIG. 27 is an example of a new patient view of the Graphical User Interface 

13 (GUI); 

14 [1056] FIG. 28 is an example ofthe new patient view partially hidden by a virtual 

15 keyboard; 

16 [1057] FIG. 29 is a page of a selected patient's report; 

17 [1058] FIG. 30 shows a view for selecting a new patient; 

1 8 [1059] FIG. 3 1 A shows a view of the tools panel; 

1 9 [1060] FIG. 3 1 B shows a view having the measure menu item selected; 

20 [1061] FIG. 31 C shows an embodiment with video-likis controls; 

21 [1062] FIG. 32 shows an example of a full screen image; 

22 [1063] FIG. 33 shows an example of a view including an annotation control panel; 
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[1064] FIG. 34 shows an example of a view including an annotation list for an 
OB/GYN; and 

[1065] FIG. 35 shows a view of a handheld ultrasound system having a windows 
based operating system. 
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1 DETAILED DESCRIPTION OF THE INVENTION 

2 [1066] The following description focuses on the presently preferred embodiment of 

3 this invention, which is typically operative in end-user ultrasound medical imaging. The 

4 present invention, however, is not limited to any particular application or any particular 

5 environment. Instead, those skilled in the art will find that the system and methods of the 

6 present invention may be advantageously applied to a variety of systems such as portable 

7 systems that may include a mobile telephone, a Personal Digital Assistant (PDA), and/or 

8 a portable computer. Therefore, the description that follows of the exemplary 

9 embodiments is for purposes of illustration and not limitation. 

10 [1067] In this specification the word "system" is to be understood as generic to 

1 1 including one element or device and to include multiple elements and/or devices. Also, 

12 in this specification the word "mode" is to be understood as generic to functions of, 

13 operations performed by, operations performed on, and/or settings of the entire 

14 ultrasound system or of any part of the ultrasound system. 

15 [1068] FIG. 1 shows a block diagram of an ultrasound system 100 according to an 

16 embodiment of the invention including output system 102, input system 104, memory 

17 system 106, processor system 108, transducer system 110, communications system 112, 

1 8 and input/output device 114. 

19 [1069] Output system 102 may include any one of, some of, any combination of, or 

20 all of a monitor system, a handheld display system, a printer system, a speaker system, a 

21 connection or interface system to a sound system, an interface system to peripheral 

22 devices (e.g., Infi-ared Data Association (IrDA) or Universal Serial Bus G^SB)) and/or a 

23 connection and/or interface system to a computer system, intranet, and/or intemet, or the 
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1 like. Input system 104 may include any one of, some of, any combination of, or all of a 

2 keyboard system, a mouse system, a track ball system, a track pad system, buttons on a 

3 handheld system, a scanner system, a microphone system, a connection to a sound 

4 system, and/or a connection and/or interface system to a computer system, intranet, 

5 and/or intemet (e.g., IrDA, USB) or the like. Memory system 106 may include, for 

6 example, any one of, some of, any combination of, or all of a long term storage system, 

7 such as a hard drive; a short terai storage system, such as random access memory; a 

8 removable storage system, such as a floppy drive or a removable drive; and/or flash 

9 memory. Processor system 108 may include any one of, some of, any combination of, or 

10 all of multiple parallel processors, a single processor, a system of processors having one 

11 or more central processors and/or one or more specialized processors dedicated to 

12 specific tasks. Also, processor system 108 may include one or more Digital Signal 

13 Processors (DSPs) in addition to or in place of one or more Central Processing Units 

14 (CPUs) and/or may have one of more digital signal processing programs that run on one 

15 or more CPU. Transducer system 110 may include any one of, some of, any combination 

16 of, or all of one or more transducers, linear arrays of transducers, and/or two-dimensional 

17 arrays of transducers, for example. The elements of the transducer arrays may be referred 

18 to as pixels, and in this specification will be referred to as transducer pixels. The term 

19 display pixel will be used to refer to pixels on a display screen. A different group of 

20 transducer pixels may be chosen fi-om the same array to obtain an image of a different 

21 aperture and/or different perspective. Transducer system 110 may also include acoustical 

22 systems for guiding and/or focusing the ultrasound beani, for example. Transducer 

23 system 110 may include antireflection layers and/or filters for filtering out noise, for 
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1 example. Processor system 108 may include one or more specialized processors for 

2 controlling transducer system 1 1 0 and/or processing signals and/or data received by 

3 transducer system 1 10. An example of the construction a transducer system 1 10 is shown 

4 in U.S. patent application serial number 10/039,910, "System and Method for Coupling 

5 Ultrasound Generating Elements to Circuitry*' filed October 20, 2001 and cited above. 

6 [1070] Communications system 1 12 communicatively links output system 102, input 

7 system 104, memory system 106, processor system 108, transducer system 1 10, and/or 

8 input/output system 1 14 to each other. Communications system 112 may include any one 

9 of, some of, any combination of, or all of electrical cables, fiber optic cables, and/or 

10 means of sending signals through air or water (e.g. wireless conmiunications), or the like. 

1 1 Some examples of means of sending signals through air and/or water include systems for 

12 transmitting electromagnetic waves such as infrared and/or radio waves and/or systems 

13 for sending sound waves. 

14 [1071] Input/output system 114 may include devices that have the dual function as 

15 input and output devices. For example, input/output system 114 may include one or more 

16 touch sensitive screens, which display an image and therefore are an output device and 

17 accept input when the screens are pressed by a finger or stylus, for example. The touch 

1 8 sensitive screens may be sensitive to heat and/or pressure. One or more of the 

19 input/output devices may be sensitive to a voltage or current produced by a stylus, for 

20 example. Input/output system 1 14 is optional, and may be used in addition to or in place 

21 of output system 102 and/or input device 104. 
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1 [1072] FIG. 2 shows a diagram of the contents of the memory system 106 of the 

2 ultrasound system 100 of FIG. 1, which includes operating system 202, master program 

3 204, applications 206, and Graphical User Interface (GUI) 208. 

4 [1073] Operating system 202 provides the programming framework for master 

5 program 204, applications 206, and GUI 208 to run. Master program 204 calls 

6 appUcations 206 and GUI 208 and decides when each application of apphcations 206 will 

7 run. Applications 206 may be programs or objects that are separate from master program 

8 204, Alternatively, any one of, some of, any combination of, or all of applications 206 . 
. 9 may be subroutines or lines of code within master program 204 rather than separate 

10 programs. One or more of applications 206 may control or perform signal processing for 

11 transducer system 110. One or more of applications 206 may process data and/or signals 

12 received by transducer system 110. GUI 208 provides guidance to a user as to how and 

1 3 when to enter input that controls master program 204. Alternatively, any part of or all of 

14 . master program 204, applications 206, and/or GUI 208 may be hardwired into processor 

15 system 108 rather than resident in memory system 106. 

16 [1074] FIG. 3 shows the main operational modes 300 of the ultrasoimd system 100, 

17 which may include a system on/off mode 302, a system configuration mode 304, a patient 

18 information mode 306, an image mode selection mode 308, an image acquisition mode 

19 310, tools mode 320, which may fiirther include a measure and annotate mode 312, a 

20 reporting mode 3 14, an archiving mode 3 16, and a system services mode 318. 

21 [1075] System on/off mode 302 tums on and shuts off the system, and determines the 

22 sequence in which various parts of the system are shutdown. In addition to or in place of 



1 the on/off buttons, a shutdown icon or tab may be provided on any one of, any 

2 combination of, or all of the views of the GUI 208. 

3 [1 076] System configuration mode 304 allows the user to preset system parameters. 

4 The preset system parameters may be set only once by the user upon receiving the 

5 ultrasound system 100 or may be set as needed. System configuration mode 304 includes 

6 a power on stage during which the system may automatically configure itself During the 

7 power on stage ultrasound system 100 may determine the battery stattis and/or transducer 

8 status when powering up and ultrasound system 100 may configure itself according to the 

9 battery and/or transducer status. In an embodiment, different options may be presented to 

10 the user depending upon the status of the battery and the status of the transducer. For 

1 1 example, if the battery is very low, the screen may display a message that the battery is 

12 low and not allow access to other Amotions vmtil the battery is recharged. Once the 

13 power up is completed the system is ready for data acquisition. System configuration 

14 mode 304 may include presets (user preferences for default settings) that determine the 

1 5 configuration of ultrasound system 1 00 after power up and/or for a given imaging 

16 selection. Ultrasound system 100 may have several sets of presets that are used for 

17 different users or different types of users. The user may have the option to archive the 

18 image's acoustic data, transducer pixel data, and/or display pixel data, and/or to 

19 determine the format and file naming convention in which the data is stored, for example. 

20 The user may be able to specify the system's language and time formats. The user may 

21 be able to specify transducer defaults, such as the type of transducer in use and the central 

22 frequency. For example, a transducer default may be that the type of transducer used is a 

23 phased array that has a central frequency of 3.0 MHz. The user may be able to set screen 
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1 defaults such as brightness, contrast, color, arrangement of tiles and the data acquisition 

2 mode (e,g., B-mode) the ultrasound system 100 is in at power up. System configuration 

3 mode 304 is discussed further in conjunction with FIG. 4, below. 

4 [1077] Patient information mode 306 includes entering and modifying data 

5 identifying and/or describing a patient, which may include filling in data fields. The data 

6 fields may be text boxes. In an embodiment, patient data shall be saved with each study. 

7 Patient information mode 306 may include allowing a user to view all or a subset of the 

8 data about a patient. After the study is complete, the data fields may be amended. 

9 Patient information mode 306 is discussed further in conjunction with FIG. 5, below. 

10 [1078] During image mode selection mode 308, ultrasound system 100 may be placed 

11 in one of several acquisition modes, such as B-mode, M-mode, color flow mode, 

12 Continuous Wave (CW) Doppler mode, and/or Pulsed Wave (PW) Doppler mode. In B- 

13 mode the ultrasound data is displayed as a.grayscale image map (e.g., 256 gray shades). 

14 The transducer pixel intensities and therefore the display pixel intensities correspond to 

15 the ultrasound strength. The location of each transducer and display pixel corresponds to 

16 the depth of the signal. During color flow Doppler mode color codes may be used to 

1 7 display velocity information fi-om multiple color sample lines, which may then be 

18 processed via autocorrelation, for example. Image mode selection mode 308 is discussed 

19 further in conjunction with FIG. 6, below. 

20 [1079] Image acquisition mode 310 gathers data to form images. The mode of the 

21 data acquisition may be set during the operational mode of image mode selection mode 

22 308. Alternatively, the mode for image acquisition mode may be set separately and 

23 independently from the image mode selected via image mode selection mode 308. In an 
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1 embodiment, the data can be viewed while being acquired. In an embodiment, the screen 

2 may be frozen using a stop/start toggle, for example, while acquiring data. During image 

3 . acquisition mode 310 various imaging parameters can be adjusted, such as depth, gain, 

4 and zoom. The image may be displayed in various display formats depending on the 

5 ^ imaging mode. For example, if the imaging mode is PW Doppler, the user may be 

6 allowed to display color flow image only, spectral only, or both. In an embodiment, of 

7 image acquisition mode 308, the data can be viewed without a control panel present. The 

8 window showing the data can be expanded to cover the entire screen. 

9 [1080] Measure and annotate mode 312 includes performing measurements on and 

10 adding annotations to an image. Measure and annotate mode 3 12 is discussed in FIGs. 

11 15 and 16, below. 

12 [1 081] Reporting mode 314 allows the user to print images, measxxrements, and 

13 calculations to a printer or a file and may allow the user to organize, categorize, and/or 

14 tabulate reports and/or data such as that gathered using measure and annotate mode 312. 

1 5 Reports can be generated in tabular or graphical form. Reporting mode 3 14 is discussed 

16 below in conjunction with FIG. 17. 

17 [1 082] Archiving mode 316 allows for the storage of large amounts of data and/or 

1 8 files such as images and/or sound files. The format of the stored data can be chosen. 

19 Archiving mode 316 may include functions for exporting data and/or images. Archiving 

20 mode 3 1 6 may allow the images and/or data to be searched, viewed, and/or stored on the 

21 ultrasound system 100 or another system. 
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1 [1083] System services mode 318 includes performing system diagnostics, getting the 

2 battery status, providing help, and/or controlling data transfer. Among other things, 

3 system services may include all monitoring functions available to the system. 

4 [1084] FIG. 4 shows the system configuration mode 304 of the ultrasound system 

5 100, which includes application type mode 402, assign presets mode 404, system defaults 

6 mode 406, define annotation dictionary mode 408, touchscreen calibration mode 410, 

7 printer setup mode 412, battery function mode 414, language mode 416, date and time 

8 mode 418, and audio setup mode 420. 

9 [1085] Application type mode 402 determines the mode of operation that the 

10 ultrasound system 100 is in at any given time and/or upon startup. The mode of 

1 1 operation at startup may be made to depend upon which user logs in, if there are multiple 

12 users. For example, the same ultrasound system may be used by a nurse, technician, 

13 cardiologist, Obstetrician/Gynecologist (OB/GYN) and/or a radiologist. Depending upon 

14 which logs in, a different set of functions and applications appears on the screen at 

15 startup. Application type mode 402 may also control changing applications during 

16 operations. 

1 7 [1086] Assign presets mode 404 allows the user to specify her or his specific presets. 

1 8 For example, the same ultrasound system 100 may be used by multiple cardiologists, 

1 9 each having her or his own preferences for how to view and/or annotate the data. Assign 

20 presets mode 404 may allow each user to assign her or his individual presets. 

21 [1087] System defaults mode 406 may include archival options such as the format or 

22 formats in which an image is automatically saved. For example, the user may be able to 

23 choose the default coordinate systems for graphs such as units of electrical current, units 
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1 of electrical charge, and/or polar coordinates. Images may be 640 x 480 display pixels, 

2 and may be data formatted as Digital Imaging and Communications in Medicine 

3 (DICOM) or Microsoft Bit Map (BMP), for example. The system defaults may also 

4 control the form of compression for the stored image. An Infrared (IR) connection or 

5 other form of propagating a signal through air or through a cable may be used to transmit 

6 a screen-captured image to a printer. System defaults mode 406 may also include the 

7 format of the date. The system user may be given the option to select the date formats, 

8 such as mm-dd-yyyy or dd-mm-yyyy. The user may be allowed to set the system date 

9 and time and the format in which the time is displayed, such as English, European, or 

10 military time. The user may be able to specify the default frequency for one or more 

1 1 transducer types. The user may be able to specify a default screen brightness level and 

12 the screen layout. The user may be able to select the location and colors of tool bars, the 

13 control areas and/or the image areas on the display. Altematiyely, a separate default 

14 mode for the user to set transducer defaults may be provided. 

15 [1 088] Define annotation dictionary mode 408 may allow the user to enter a spelling 

16 dictionary to be used to check spelling while making annotations. Optionally, define 

17 annotation dictionary 408 may also allow the user to access a thesaurus for choosing the. 

1 8 wording of annotations. Define annotation dictionary 408 may also allow the user to 

19 establish a dictionary (e.g., a list) of common annotations or common types of 

20 annotations to choose fi-om that can be added to an image or build a thesaurus of 

21 annotations that can be substituted one for another. The annotation dictionary (associated 

22 with define annotain dictionary mode 408) and/or thesaurus may include icons and text 



1 such as units, Greek letters, mathematical or medical symbols, and/or medical or 

2 ultrasound terms. 

3 [1089] Touchscreen calibration mode 410 is optional and may be left out in 

4 embodiments of ultrasovmd system 100 not having a touchscreen. Touchscreen 

5 calibration may allow the user to establish positioning or reference coordinates, which 

6 may be established with the use of a stylus or by entering the coordinates into a dialogue 

7 box, for example. Touchscreen calibration mode 410 may additionally or altematively 

8 allow the user to change the sensitivity of the touchscreen and/or which parts of the 

9 touchscreen respond to touch. The user may be able to change the sensitivity so that 

10 different parts of the screen have different sensitivities. Also, for example, the user may 

11 be able to change the size of the interactive touchscreen portion. 

12 [1090] Printer setup mode 412 may allow the user to choose the type of printer, the 

1 3 location of the printer, the type of paper, the orientation of the image on the paper, how 

14 many and the tiling of the images in the view or frame of a page about to be printed, 

1 5 whether to print to paper or to a file, the margins and/or the fonts, for example. 

16 [1091] The battery function mode 414 may include an estimate of how much longer 

17 the battery will last using the current system settings. In an embodiment, the user may 

1 8 use battery function mode 414, for example, understand how keeping a particular feature 

19 active affects the battery lifetime. In an embodiment, the user could use battery function 

20 mode 414 to simply monitor how much battery life remains. 

21 [1092] Language mode 416 allows the user to choose the language (e.g., Japanese) in 

22 which iiltrasound system 100 will display information. In an embodiment, the user can 

23 choose a code or an interactive code language, such as graffiti. 
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1 [1093] Date and time mode 418 allows the user to set the date and time. An example 

2 of a user selectable setting is setting the ultrasound system lOO's clock to automatically 

3 switch to daylight savings. The format of the time discussed in conjunction with system 

4 defaults mode 406 may be adjustable through date and time mode 418 in addition to or 

5 instead of being adjustable through system defaults mode 406. 

6 [1094] Audio setup mode 420 may allow the user to set the volume during recording 

7 and broadcasting. The user may also be able to choose which features will be voice 

8 enabled. Audio setup mode 420 may also provide training sessions to train the 

9 ultrasound system 100 to recognize the user's voice or to recognize specific conmiands. 

10 [1095] Although not shown system configuration mode 304 may include a Region of 

1 1 Interest (ROI) defaults mode that allows the user to select the default size, shape and 

12 position of the ROI. In an embodiment, the user may be able to select a type of feature 

1 3 that the ROI will automatically include. A mode may also be included for choosing the 

14 startup screen. Alternatively, ROI defaults and setting the startup screen may be part of 

15 system defaults mode 406. Any one of, any combination of, or all of the system 

1 6 configuration parameters may be part of one or more presets or defaults and adjustable 

17 using assign presents mode 404 and/or system defaults mode 406. 

18 [1096] FIG. 5 shows the patient information mode 306 of the ultrasound system 100, 

19 which includes default patient information mode 502, create new patient mode 504, edit 

20 patient mode 506, search mode 508, and delete patient mode 510. 

21 [1097] Default patient information mode 502 displays the information associated with 
22 , a default patient. The default patient may be the patient that was being tested last or 

23 whose medical information was being reviewed last, for example. When entering the 
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1 patients name the ultrasound system 100 may guess at who the patient is based on 

2 parameters such as the frequency the patient's information was viewed in the past and/or 

3 the letters of the patient's name that were entered. As more letters are entered, ultrasound 

4 system 100 may update its guess as to which patient should be displayed. The user may 

5 have a choice as to the basis of choosing the default patient. 

6 [1098] Create new patient mode 504 sets up space in memory identified with a new 

7 patient. An example of such a space is a new folder for the new patient. The new folder 

8 may be created or downloaded automatically by another system associated with a hospital 

9 or doctor's office, for example. Continuing with the example, the automatic file 

1 0 download or creation may occur upon an entry to the other system, a determination that 

11 an ultrasound scan should be performed, and/or the next time after the entry that the 

12 ultrasound system 100 is connected to the other system. The user could determine when 

13 and how frequently the other system is checked for new patients. The number of patient 

14 files stored in ultrasound system 100 may be significantly smaller than the total number 

15 of patients in the other system so as not to burden ultrasound system 100 with storing the 

16 other system's entire database of patients. After examining one group of patients create % 

17 new patient mode 504 may create a new group of patients that have not been examined 

18 yet or that needs fiirther testing. . 

19 [1099] Edit patient mode 506 may allow the user to edit patient information. It may 

20 be possible to edit any patient information entered during create new patient mode 504. 

21 In an embodiment, immediately after a new patient folder is opened in the create new 

22 patient mode 504, ultrasound system 100 switches to edit patient mode 506 where the 

23 information about the new patient is entered. 
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1 [1100] Search mode 508 allows the current database of patients to be searched. The 

2 search may be performed by searching for a string of search terms connected together by 

3 logical operators. The terms may include keywords and the user may be capable of 

4 limiting the search for one or more of the keywords to specific fields, such as patient 

5 name or attending physician. The string of search terms may include smaller strings of 

6 search terais that are searched in a specific field. 

7 [1101] Delete patient mode 510 may allow for the deletion of a patient fi"om the 

8 . ultrasound system 100. Delete patient mode 510 may allow for the deletion of the 

9 information associated with one or multiple patients simultaneously. So as not burden 

10 ultrasound system 100 with storing another system's entire database of patients, aifter 

1 1 downloading the patient information of a first group of examined patients, delete patient 

12 mode 510 may delete the patient information of that group so that another group of 

13 patient information files can be downloaded to ultrasound system 100. 

14 [1102] FIG. 6 shows the image mode selection mode 308 of the ultrasound system 

15 100, which may include any one of, some of, any combination of, or all of B-mode 602, 

16 color flow mode 604, power Doppler mode 606, PW Doppler mode 608, Continuous 

17 Wave (CW) Doppler mode 610, M-mode 612, fireeze mode 614, and fiill screen mode 

18 618.^ 

1 9 [1 103] Although not shown other modes that may be included in image mode 

20 selection mode 308 are B-flow mode, color Doppler mode, color M-mode, A-mode, and 

21 tissue harmonics mode, for example. PW Doppler can be mixed with nearly any mode 

22 while CW Doppler is usually used alone but can also be combined with other modes 

23 within image mode selection mode 308. Combinations of modes are possible, for 
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1 example, some possible mode combinations that may be included in ultrasound system 

2 100 are B-mode and color-PW Doppler, B-mode and color M-mode, and/or and B-flow 

3 mode. 

4 [1 104] B-mode 602 produces a two-dimensional array of points, each point varies in 

5 brightness according to an echo's strength. Generally the strength of the echo 

6 corresponds to the location of the source of the echo. Consequently, the image produced 

7 is similar to a photographic or x-ray image. B-mode 602 is discussed further in FIG. 7, 

8 below. 

9 [1 105] Color flow mode 604 uses color to display velocity and/or flow. The flow 

10 may be determined using the Doppler effect in combination with a Doppler mode of 

1 1 operation or by plotting the changes in position of objects that are being carried by the 

12 flowing material. Color flow mode 604 is further discussed in FIG. 8, below. 

13 [11 06] The Doppler effect is used to determine flow information in the power 

14 Popplermode606, PW Doppler mode 608, and CW Doppler mode 6 10. Different 

1 5 velocities correspond to different changes in the frequency of the sound. The shift 

16 between the transmitted and received signal is measured. The lack of any shift indicates 

17 that the object is stationary. A positive shift indicates flow in one direction and negative 

1 8 flow indicates flow in the other direction. 

19 [1 107] Power Doppler mode 606 displays the strength of the Doppler shifted echoes 

20 as pulses on a graph having the strength of the shift on one axis and time on another. The 

21 strength of the Doppler shifted echoes could be measured in several ways, such as the 

22 amplitude, power, intensity, or energy of the signal. Power Doppler mode 606 may show 
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1 how strong of a reflection occurs at each point measured. Power Doppler mode 606 is 

2 discussed in FIG. 9, below. 

3 [11 08] P W Doppler mode 608 uses ultrasound pulses rather than a continuous wave. 

4 PW Doppler mode 608 is also called the spectral Doppler mode. PW Doppler mode 608 

5 studies a sampled set of the flow velocity at a point or finite region giving the spectrum 

6 of velocities at that region. A set of transducer elements sends pulses and the same or a 

7 different set of ultrasound transducer elements listens for the pulses after they are 

8 modified (e.g., reflected) by a medium under investigation. The motion monitored by 

9 PW Doppler is sampled rather than continuously monitored because of the use of the 

10 pulses. PW Doppler mode 608 is further discussed in FIG. 10, below. 

11 [1 1 09] C W Doppler mode 6 1 0 uses a continuous ultrasound wave to produce the 

12 Doppler shift in frequency to study the average velocity along a line. Some transducers 

13 in the array are dedicated to transmitting the ultrasound signal continuously, while others 

14 are dedicated to receiving the ultrasoimd signal continuously. CW Doppler mode 610 is 

1 5 further discussed in FIG. 1 1 , below. ^ 

16 [1110] The color flow mode 604 can be combined with any of the power Doppler - 

17 mode 606, PW Doppler mode 608 and/or CW Doppler mode 610, color coding the 

18 velocities, for example. 

19 [1111] M-mode 612 studies a strip or a line along a medium under investigation 

20 rather than giving a two-dimensional image plotted as echo penetration depth versus 

21 time. This mode is used for studying motion. Stationary structures appear as straight 

22 lines. M-mode 612 is further discussed in FIG. 12, below. 

23 [1112] Color M-mode has the color flow mode overlaid on the M-mode. 
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1 [1113] Color Doppler mode shows the B-mode either moving or frozen at the sanie 

2 time as the Doppler mode. A ROI showing the flow information is placed above the 

3 Doppler image. 

4 [1114] B-flow mode represents the flow as motion just as flow would appear in an 

5 anatomically correct image. The flow appears as changes in the speckled pattem. The B- 

6 flow mode may be facilitated by using broad beam technology, because by gathering the 

7 data with a broad beam rather than a pencil beam and/or by processing the flow data and 

8 the B-mode data simultaneously fewer transmit receive cycles are necessary to obtain an 

9 image than would be used by beam forming technology. Consequently, the motion of the 

1 0 vessel containing the flow is removed or reduced when compared to a prior art beam 

1 1 forming method. 

12 [1115] The modes that could be included in image mode selection mode 308 are not 

13 limited to those shown, discussed, or depicted. For example, although not shown a tissue 

14 harmonics mode could also be included in image mode selection mode 308. A tissue 

15 harmonics mode is a two-dimensional gray scale image that measures nonlinearities in 

1 6 tissue. One way of accomplishing this gray scale imaging is by looking at the first order 

17 harmonics rather than the fundamental harmonic. Tissue harmonics mode can be useful 

18 in determining the nature of an interface, such as a tissue interface, for example. . Other 

19 modes could include looking at second and higher order harmonics in a two-dimensional 

20 gray scale plot. 

21 [1116] Another imaging mode that may be incorporated in some embodiments of 

22 ultrasound system 100 is A-mode, which is a plot of echo amplitude versus depth into the 

23 medium under investigation. This mode is sometimes used in ophthalmology. 
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1 [1117] Freeze mode 614 allows the image to be held frozen (e.g., by pressing a 

2 stop/start toggle) during data acquisition so that the image can be annotated and 

3 measurements can be taken on the image. Freeze mode 614 may be capable of displaying 

4 a split screen in which half of the screen is frozen and the other half shows the data being 

5 acquired or a cinema (cine) loop. Freeze mode 614 will be discussed further in 

6 conjunction with FIG. 13, below. 

7 [1118] Full screen mode 6 1 8 allows the user to view the image without viewing a 

8 control panel or tool bar. The image may appear with some annotations to allow the user 

9 to know the settings being used and/or some patient information and/or history. 

10 Alternatively, the image may be viewable without any. annotations or the annotations may 

1 1 appear as a default but can be removed after the data is acquired and/or the image is 

12 expanded to the fiiU screen. 

13 [111-9] FIGs. 7-13 have several modes in conmion, which will be described together 

14 inmiediately after FIG. 13. 

15 [1120] FIG. 7 shows the B-mode 602 of the ultrasound system 100, which includes 

16 minimal modes 738 haying gain mode 702 and depth mode 704 and factory defaults 740 

17 including minimal modes 738, tissue harmonics mode 706, frequency mode 708, zoom 

18 mode 710, up/down invert mode 712, and left/right invert mode 714. B-mode 602 of 

19 FIG. 7 also includes far gain mode 716, near gain mode 718, maps mode 720, dynamic 

20 range mode 722, acoustic output mode 724, auto optimize mode 725, and image presets 

21 742 having Depth Gain Compensation (DGC) offset mode 726, edge enhancement mode 

22 728, line spacing and frame rate mode 730, image compounding mode 732, aperture 

23 mode 734, and persistence mode 736. 
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1 [1121] Depth mode 704 is used to determine the depth of the field of view of the 

2 ultrasound image and/or to determine the depth at which the data is to be gathered. 

3 Lower frequencies are used for deeper imaging, while higher fi-equencies are used for 

4 more shallow imaging. 

5 [1 122] Tissue harmonics mode 706 was explained in conjunction with FIG. 6. In an 

6 embodiment, when ultrasound system 100 is in tissue harmonics mode 706 all of the 

7 modes available under B-mode 602 are available. Although tissue harmonics mode 706 

8 is illustrated as a mode of the B-mode 602, tissue harmonics mode 706 or any one B- 

9 mode 602 's modes could be its own mode of operation. 

10 [1 123] Frequency mode 708 allows the user to set the frequency of the ultrasound 

1 1 pulse being transmitted from the transducer array. Zoom mode 710 allows the user to get 

12 an exploded view of a region of interest. Maps mode 720 allows the user to set the gray 

13 scale, which may be a linear, logarithmic, or another nonlinear function. 

14 [1 1 24] Up/down invert mode 7 1 2 and left/right invert mode 7 1 4 can be used to 

15 accommodate viewing a display screen from a different orientation. Up/down invert 

16 mode 712 allows the user to flip the image region and/or the entire GUI 208 about a 

17 horizontal line at the center of the screen thereby switching top and bottom, while 

18 left/right invert mode 714 allows the user to flip the image and/or the entire GUI about a 

19 vertical line at the center of the image thereby switching right and left and creating a 

20 mirror image. Alternatively, up/down invert mode 712 may rotate the image until it is 

21 upside down while left/right invert may rotate the image until the top of the image is to 

22 the right of the screen or the left of the screen. 
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1 [1125] Far gain mode 716 allows the user to alter the gain in a region of the image far 

2 from the location of the transducer in the image, while near gain mode 718 allows the 

3 user to alter the gain in a region of the image near to the location of the transducer in the 

4 image. The gain within the regions in between automatically adjusts so that the gain 

5 varies smoothly across the image. 

6 [1126] Dynamic range mode 722, acoustic output mode 724, and auto optimize mode 

7 725 are discussed below. 

8 [1 127] DGC (also referred to as. Time Gain Correction (TGC)) mode 726 is used to 

9 compensate for attenuation of the signal due to the depth the signal traveled into the 

10 medium under investigation so that the image has a xmiform brightness. DGC mode 726 

11 is similar to the combination of far gain mode 716 and near gain mode 718, except that 

12 DGC mode 726 divides the whole field of view in multiple zones (e.g., six) or ,r 

1 3 continuously varies the gain according to a ftmction of depth rather than dividing the field. ■ 

14 of view in two zoiies (far and near). The user may be allowed to adjust the amount of ^ 

15 gain and/or how the gain varies using DGC mode 726. Altematively, DGC mode 726 \; 

16 may be a digital gain correction mode, which controls the offset for the gain rather than a Ou, , *^ 

1 7 multiplicative increase of the gain. In. an embodiment, B-mode may include both a 

1 8 . digital gain correction mode and a dynamic gain correction mode. 

19 [1128] Edge enhancement mode 728 is described below. 

20 [1 129] Line spacing and frame rate mode 730 controls the spacing between lines on 

21 the display screen, which controls the resolution and also controls the time between 

22 frames. 
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1 [1130] Image compounding mode 732 combines multiple images into one image. For 

2 example, the images may be taken at different frequencies to get different depths. Image 

3 compounding mode 732 is dependent on the type of imaging mode. Image compounding 

4 mode 732 may be dependent also on the transducer type because different transducer 

5 types tend to be used for different types of imaging. For example, in B-mode 602 the 

6 user is likely to want to change the frequency to image different depths, while with a 

7 linear array transducer the user may want to form a compound image made up of images 

8 formed from different groups of transducer pixels. Image compounding from different 

9 positions using B-mode imaging may involve determining how the images from different 

10 positions overlap one another, such as by finding common elements on both images and 

11 matching them. 

12 [1131] Apertxu-e mode 734 determines the magnitude or intensity of the transmit 

13 profile. A flat aperture has an equal intensity for all transducer pixels. Aperture mode 

14 734 is usefiil in apodisation or in shaping the ultrasound beam to be more Gaussian. 

15 Aperture mode 734 may also include a determination of which transducer pixels on a 

16 two-dimensional array are to be used for imaging and/or a determination of the shape of 

17 the transmit profile. 

1 8 [1 132] Persistence mode 736, minimal modes 738, factory defaults 740, and image 

19 presets 742 are discussed below. 

20 [1133] FIG. 8 shows the color flow mode 604 of the ultrasound system 100, having 

21 minimal modes 836 including ROI mode 802, gain mode 804, and scale mode 806, and 

22 factory defaults 838 including minimal modes 836, ROI size mode 808, steer mode 810, 

23 invert mode 812, and maps mode 814. Color flow mode 604 also includes baseline mode 
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1 816, acoustic output mode 818, auto optimize mode 819, and image presets 842 including 

2 dynamic range mode 820, packet size mode 822, threshold mode 824, edge enhancement 

3 mode 826, frequency mode 828, line spacing and frame rate mode 830, persistence mode 

4 832, and flash suppression mode 834. 

5 [1134] ROI mode 802, gain mode 804, and scale mode 806 are discussed below. 

6 [1135] During ROI size mode 808 the user can choose the size of the ROI. During 

7 steer mode 810 the user can change the direction of the ultrasound beam. Invert mode 

8 812 inverts the color coding changing the low frequency (or long \vavelength) colors to 

9 high frequency (or short wavelength) colors and high frequency (or short wavelength) 

10 colors to low frequency (or long wavelength) colors so as to change the direction of flow. 

1 1 [1136] Maps mode 814, baseline mode 816, acoustic output mode 818, auto optimize 

12 mode 819, dynamic range mode 820, packet size mode 822, threshold mode 824, edge 

1 3 enhancement mode 826, frequency mode 828, line spacing and frame rate mode 830, 

14 persistence mode 832, and flash suppression mode 826, minimal modes 836, factory 

1 5 defaults 838, and image presets 840 are discussed below. 

16 [1137] FIG. 9 shows the power Doppler mode 606 of the ultrasound system 100, 

17 having minimal modes 934 including ROI mode 902, gain mode 904, and scale mode 906 

1 8 and factory defaults 936 including minimal modes 934, ROI size mode 908, steer mode 

19 910, and maps mode 912, which are discussed below. Power Doppler mode 606 also has 

20 baseline mode 914, acoustic output mode 916, auto optimize mode 917, and image 

21 presets 938 including dynamic range mode 918, packet size mode 920, threshold mode 

22 922, edge enhancement mode 924, frequency mode 926, line spacing and frame rate 



1 mode 928, persistence mode 930, and flash suppression mode 932, which are also 

2 discussed below. 

3 [1138] FIG. 10 shows the PW Doppler mode 608 of the ultrasound system 100, 

4 having minimal modes 1030 including cursor mode 1002, scale mode 1004, and gain 

5 mode 1006 and factory defaults 1032 including minimal modes 1030, display format 

6 mode 1008, gate position mode 1010, baseline mode 1012, spectral invert mode 1014, 

7 auto optimize mode 1016, and update on/off mode 1018. PW Doppler mode 608 of FIG. 

8 10 also includes gate size mode 1020, sweep speed mode 1022, and image presets 1034 

9 having dynamic range mode 1024, filter mode 1026, audio settings mode 1027, and edge 

10 enhancement mode 1028. 

1 1 [1139] Cursor mode 1002, scale mode 1004, gain mode 1006, display format mode 

12 1008 are discussed below. 

13 [1 140] Gate position mode 1010 determines the position and gate size mode 1 020 

14 determines the size of the gate (i.e., window) of the PW Doppler mode 608. To 

1 5 elaborate, the PW Doppler mode 608 has a line along which the P W Doppler data is 

16 measured. Along that line the position that the PW Doppler mode 608 measurement is 

1 7 taken can be varied and the size of the region from which the data is gathered can also be 

18 varied. The gate size is the size of the region from which the data is gathered, and the 

1 9 gate position is the position from which the data is gathered. 

20 [1141] Baseline mode 1012 will be described below. 

21 [11 42] Spectral invert mode 1014 inverts the spectrum so as to invert the direction of 

22 flow. 

23 [1143] Auto optimize mode 1016 and update on/off mode 1018 are discussed below. 
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1 [1144] Seep Speed mode 1022, dynamic range mode 1024, and filter mode 1026 are 

2 discussed below. 

3 [1 145] Audio settings mode 1 027 allows the user to hear the Doppler spectrum rather 

4 than just see it. Whenusingheadphones, the flow direction can be indicated by the ear to 

5 which the sound is sent. The user may be able adjust the function that maps the velocity 

6 to the sound by changing the volume or the gain associated with the sound, for example. 
1 [1146] Edge enhancement mode 1028, minimal modes 1030, factory defaults 1032, 

8 and image presets 1034 are discussed below. 

9 [1147] FIG. 11 shows the CW Doppler mode 610 of the ultrasound system 100, , 

10 having minimal modes 1 124 including cursor mode 1 102, scale mode 1 104, and gain 

1 1 mode 1 106 and factory defaults 1 126 including minimal modes 1 124, display format 

12 mode 1 108, baselme mode 1110, sweep speed mode 1112, and image presets including 

13 auto optimize mode 1114, update on/off mode 1116, dynamic range mode 1118, filter 

14 mode 1 120, and edge enhancement mode 1 122. 

15 [1148] Cursor mode 1 102, scale mode 1 104, gain mode 1 106, display format mode 

16 1 108, baseline mode 1110, sweep speed mode 1 1 12, auto optimize mode 1 1 14, update 

17 on/off mode 1116, dynamic range mode 1118, filter mode 1 120, and edge enhancement 

1 8 mode 1 122, minimal modes 1 124, factory defaults 1 126, and image presets 1 128 are 
19. discussed below. 

20 [1149] FIG. 12 shows the M-mode 612 of the ultrasound system 100, having minimal 

21 modes 1214 including cursor mode 1202 and gain mode 1204. M-mode 6112 also 

22 includes factory defaults 1216 having minimal modes 1214, display format mode 1206, 

23 and sweep speed mode 1208. M-Mode 612 of FIG. 12 also includes auto optimize mode 
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1 1209 and image presets having dynamic range mode 1210, and edge enhancement mode 

2 1212. All of the modes of FIG. 12 are discussed below. 

3 [1150] FIG. 13 shows the freeze mode 614 of the ultrasound system 100, having cine 

4 mode 1302, annotate mode 1304, measure mode 1306, zoom ROI mode 1308, and gain 

5 mode 1310. 

6 [1151J Cine mode 1302 allows the user to view a group of images as a motion 

7 picture. The motion picture can be stopped and started using a start/stop toggle or a 

8 freeze/unfreeze icon, for example. The user can also control whether the group of images 

9 under the cine control of cine mode 1302 is being viewed backwards or forwards, 

10 whether the set of images should automatically be viewed oyer again after reaching the 

1 1 last image, how many times the set of images should be viewed and the speeds with 

12 which the images are displayed (i.e., the time between the displaying two images), for 

13 . example. Cine mode 1302 may also or alternatively allow individual frames to be 

14 viewed a single frame at a time, and may have controls available to the user for stepping 

15 forward or backward one frame at a time. In an embodiment, cine mode 1302 may have 

16 options for skipping one or more frames each time it steps forward or backward. In an 

1 7 embodiment, the frames may be viewed while skipping one or more individually selected 

18 frames or groups of frames. In an embodiment, the frames may be viewed while skipping 

19 one or more frames at fixed intervals. 

20 [1 152] In an embodiment, the display screen may present video recorder or Video 

21 Conference Recorder (VCR)-like controls, which are described ftirther in connection with 

22 FIG. 3 1 C, below. In an embodiment, the icons used for the cine controls suggest their 

23 respective fiinctions to the user. For example, arrows pointing left may suggest playing 
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1 the images in reverse chronological order or backwards, while arrows pointing right may 

2 be used for playing the images in chronological order or forwards. 

3 [1 153] During annotate mode 1304 the user may perform annotations on a frozen 

4 , image. The user may be given the option to place any number of annotations anywhere 

5 on the image and may be free to choose the type of annotation and its text. In an 

6 embodiment the annotations may be of a text type and/or image type, for example. Some 

7 annotations may automatically appear on an image, where the annotations are specific to 

8 the type of image or type of data collected. There may be annotation text boxes that 

9 automatically appear on the image for the user to fill in, such as one for the patients name 

10 or weight. Annotate mode 1304 may include a feature that allows the user to attach a 

1 1 voice message to an image, for example. . 

12 [1154] Measure mode 1306 allows measurements to be taken on the frozen image. 

13 Measure mode 1306 is fiirther discussed below in conjunction with FIG. 14. 

14 [1155] Zoom ROI mode 1308 may allow a user to select a Region Of Interest (ROI) 

15 and zoom in and out, magnifying the ROI. In some cases the ROI may be automatically 

16 selected or a product of the data acquisition process. The user may be able to perform 

17 measurements (using measure mode 1306, for example) and add annotations (using 

18 annotate mode 1304, for example) within the ROI whether or not it is enlarged while in 

19 the zoom ROI mode 1308. 

20 [11 56] Gain mode 1 3 1 0 is discussed below. 

21 [1157] As noted above, FIGs. 7-13 have modes and other features that are common to 

22 multiple display modes including gain modes, maps modes, acoustic output modes, scale 

23 modes, dynamic range modes, edge enhancement modes, line spacing and frame rate 
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1 modes, frequency modes, filter modes, packet size modes, threshold modes, persistence 

2 modes, flash suppression modes, cursor modes, auto optimize modes, minimal modes, 

3 defaults, and presets. 

4 [1158] Gain modes 702, 804, 904, 1006, 1 106, and 1310 of FIGs. 7-1 1 and 13, 

5 respectively, are essentially the same, and allow the gain to be adjusted, thereby changing 

6 the intensity of all or part of the image and/or data. In addition to being able to adjust the 

7 overall gain, the gain of different regions of the image may be different and individually 

8 adjusted. The user may be able to choose from one or more predetermined fiinctions 

9 and/or input one or more user defined fiinctions that describe how the gain should vary 

10 throughout the image. The specific predefined fiinctions describing the gain and/or the 

1 1 rnodes available for adjusting the gain that are most convenient to use may differ for 

12 different modes of operation. Consequently, which predefined fimctions or modes of 

13 adjusting the gain that are made most readily available or.that are made available to the 

14 user may differ for different operational modes. Adjusting the gain can aid in removing 

15 edge distortions, for example. The gain settings of the different modes are set 

16 independently from one another. The gain can be automatically optimized by pressing a 

17 button or icon, for example. Alternatively, ultrasound system 100 can monitor the image 

1 8 being displayed and automatically update the gain optimization. 

19 [1159] Maps modes 720, 814, and 912 of FIGs. 7-9 allow the user to set the mapping 

20 . of the display pixel values to the acquired measured signal values. In the case of maps 

21 mode 720 the mapping is a gray scale, while in the case of maps modes 814 and 912 the 

22 mapping is a color assignment. The maps modes 720, 814, and 912 may allow a gray 
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1 scale or color scale to be adjusted according to a function, such as a sigmoidal function. 

2 The maps modes 720, 814, and 912 are described further in conjunction with FIG. 26 C. 

3 [1 1 60] Acoustic output modes 724, 8 1 8, and 9 1 6 of FIGs. 7-9 determine the amount 

4 of energy in and/or the frequency of the acoustic beam or pulse, which the user may 

5 control. 

6 [1161] Dynamic rangemodes722, 820,918, 1024, 11 18, and 1210 of FIGs. 7-12 are 

7 similar to compression and allow the user to choose the range of the brightnesses 

8 included in the gray scale or the range of colors used in the color assignments. In an 

9 embodiment there may be a minimum and/or maximum brightness threshold in which 

10 data and/or display pixels that would otherwise be dimmer than the threshold may be 

1 1 displayed unlit. In an embodimeirit, there may be a minimum and maximum threshold for 

12 frequency and/or wavelength in which colors of frequencies and/or wavelengths outside 

13 of the these thresholds may be displayed unlit. The compression may be nonlinear such 

14 as a logarithmic or another function. A logarithmic scale can bring out the details of the 

15 dim display pixels while also allowing the user to see the brighter display pixels. Thus 

16 using a logarithmic scale allows a larger range of transducer pixel values to be displayed 

17 on with the same range of display pixel values than were a linear scale used. In an 

18 embodiment, dynamic range modes 820, 918, 1024, 1 1 18, and 1210 of FIGs. 8-12 can 

19 only be adjusted through the system defaults mode 406 (FIG. 4), while dynamic range 

20 mode 722 can be adjusted during B-mode 602. In an embodiment, dynamic range mode 

21 722 can also only be adjusted during the system defaults mode 406. Alternatively, any 

22 one of, any combination of, or all of dynamic range modes 720, 820, 918, 1024, 1118, 
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1 and 1210 of FIGs. 8- 12 can be adjusted during their respective mode of operation and/or 

2 during system defaults mode 406. 

3 [1162] Auto optimize modes 725, 819, 917, 1016, 1 1 14, and 1209 of FIGs. 7-12 

4 automatically optimize the display to make it easier to read. Auto optimize may include 

5 optimizing any one of, all of, or any combination of the gain, contrast, compression 

6 maps, adjusting the position of the image on the screen, edge enhancement, persistence, 

7 flash suppression, and/or baseline shift, for example. The optimization is activated by the 

8 user pushing a button and/or selecting a menu item and/or icon. The user may choose 

9 settings to determine how the optimization is performed. The display image may be 

10 monitored and either automatically update the settings to optimize the image or alert the 

1 1 user that an optimization may improve the viewing. An example of an auto optimization 

12 for a map may be that a gray scale is automatically selected for the display pixels such 

13 that the highest signal values of the transducer pixels are displayed using highest display 

14 pixel values. Another example of an auto optimization is automatically setting the • 

15 dynamic range the display pixel values to span the range of transducer pixel signal values 

1 6 between an average maximum value and a minimum value, thereby filtering put noise 

17 and high intensity artifacts. 

18 [1163] Edge enhancement modes 728, 826, 924, 1028, 1 122, and 1212 of FIGs. 7-12 

19 filter, out noise at the edge of the image. Edge enhancement modes 728, 826, 924, 1028, 

20 1 122, and 1212 may include different temporal and/or other filters. Edge enhancement 

21 modes 728, 826, 924, 1028, 1 122, and 1212 may show the first derivative of the image to 

22 aid in finding the edges of the image, and then perform filtering along the edge to bring 

23 out various details. Edge enhancement modes 728, 826, 924, 1028, 1 122, and 1212 may 
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1 include a filter that smoothes spikes in the data at the edges by, for example, averaging 

2 each point along or near the edge with neighboring points or removing points with values 

3 over a given threshold. In an embodiment, when the image exceeds the available display 

4 area or as a by product of performing Fourier transforms on the image data (which is 

5 typically not periodic) and of the periodicity of Fourier transforms, the image "spills" 

6 over and overlays its own opposite edge. This "spilling" creates noise or a misaligned 

7 image. Edge enhancement mode may be used to eliminate or reduce noise or 

8 misalignment. 

9 [1164] Line spacing and frame rate modes 730, 830 and 928 of FIGs. 7-9 control the 

10 resolution by controUing the number of lines displayed on the ultrasound system lOO's 

1 1 screen. Line spacing and frame rate modes 730, 830 and 928 may allow adjustments to 

1 2 the frame rate or adjusting the frame rate may be its own mode. 

13 [1165] Persistence modes 736, 832 and 930 of FIGs. 7-9 determine a weighting factor 

14 of the previous image to the new image information while viewing data. An image 

15 having a 1/1 0th persistence could be composed of a weighted average consisting of 

16 9/lOth the image just displayed and 1/lOth the new image. Alternatively, persistence 

17 could be defined to be an equally weighted average of the last several images. For a 

18 1/1 0th persistence each image is an average of the previous 10 sets of image information. 

19 A 1/1 0th persistence means that it takes roughly 10 new images to remove the first 

20 image. Persistence modes 736, 832, and 930 have the effect of filtering out high 

21 frequency changes. In an embodiment, the weighting ifactors associated with the 

22 persistence is adjusted automatically and/or dynamically. The user may be able set the 
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1 weighting factors and/or parameters related to criteria for automatically choosing the 

2 weighting factors. 

3 [1166] In FIGs. 7-12 the various modes may be grouped into boxes labeled minimal 

4 modes 738, 836, 934, 1030, 1 124, and 1214, factory defaults 740, 838, 936, 1032, 1 126, 

5 and 1216, and image presets 742, 840, 938, 1034, 1 128, and 1218. However, none of, 

6 any one of, some of, or all of the modes of ultrasound system 100 could be grouped in 

7 any of these boxes. In an embodiment, modes in the boxes minimal modes 738, 836, 

8 934, 1030, 1 124, and/or 1214 are the minimal modes that are presented to the user at 

9 anytime during the imaging mode ofFIGs 7-12, respectively. For example, in an 

10 embodiment, when in B-mode 602 (FIG. 7) gain mode 702 and depth mode 704 in the 

11 box minimal modes 738 are always made available for the user to select. In an 

12 . embodiment, modes in the boxes factory defaults 740, 838, 936, 1032, 1 126, and/or 1216 

13 . may be set with initial default values by the manufacturer. Similarly, in an embodiment, 

14 modes in the boxes imajge presets 742, 840, 93 8 ^ 1 034,; 1 128, and 12.18 niay be preiset 

1 5 and/or adjustable only during assign presets mode 404 (FIG. 4). 

16 [1167] ROI modes 802 and 902 allow the user to choose a region of interest in which 

17 to perform a color flow study or a power Doppler study. 

18 - [1168] Scale modes 806, 906, 1004, and 1 104 of FIGs. 8-11 allow the user to select 

19 .the scale for representing Doppler information, such as velocity, power, and/or variance. 

20 Setting the lower limit of the scale is directly related to the selection of a "wall filter." 

21 The "wall filter" is a high pass filter, which filters out the slow motion of the blood vessel 

22 wall. The high pass filtering can be implemented by Fourier transforming or otherwise 

23 spectrum analyzing the data and locating the low frequency spike that corresponds to the 
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1 slow motion of the blood vessel walls. The low frequency spike can then be removed. 

2 For example, all data below a cutoff frequency could be removed from the image, and the 

3 low frequency spike could be used to determine the cutoff frequency. In an alternative 

4 embodiment, the contribution to the data from the slow motion of the blood vessel could 

5 be removed by subtracting the expected contribution of the slow motion blood vessel 

6 from the data. In an embodiment, the slow motion may be extracted and viewed 

7 separately from the faster moving phenomenon. Optionally, each point on the image may 

8 be displayed in a different color according the velocity of the part of the medium under 

9 investigation represented. Any given user may be accustomed to, or have preference for, 

10 a different color map velocity scale (i.e., a different mapping associating each velocity 

1 1 with a particular color). Scale modes: 806, 906, 1004, and 11 04 may allow the user to 

12 determine the color map velocity scale, which the user can adjust during this mode. 

13 [11691 Baseline modes 816, 914, and 1012 allow the user to adjust where the baseline 

14 of a plot is located. If the baseline is too high up on the screen, the top of the plot will 

15 ("wrap around" or "fold" to the bottom of the plot or will) be cut off and may appear at 

16 the bottom of the plot. In another embodiment, when the baseline is too high the top of 

17 the signal may be cut without appearing at the bottom of the plot. Baseline mode 816, 

18 914, and 1012 may allow the user to adjust the position of the baseline on the plot by, for 

19 example, dragging and. dropping the baseline using the cursor. 

20 [11701 Packet size modes 822 and 920 of FIGs. 8 and 9 determine the number of . 

21 pulses per cycle (i.e., flow count samples) emitted by the transducer, which are used to 

22 measure the velocity of the flow. Each point of the medium under investigation may 

23 have a different velocity. The collection of velocity vectors describing the flow within 
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1 the medium under investigation fomi a vector field (i.e., a velocity field). Packet size is 

2 the count of flow samples used to determine the velocity field of the flow. The higher the 

3 count, the better the estimation of the flow's velocity field, but the slower the fi-ame rate. 

4 The user may be allowed to adjust the flow count samples to control the accuracy and/or 

5 resolution of the velocity flow measurement. 

6 [1171] Threshold modes 824 and 922 of FIGs. 8 and 9 are used to determine the 

7 various thresholds and/or flow threshold, which is a multi-parameter criterion used to 

8 indicate the presence or the absence of color flow. Typical parameters of the flow 

9 threshold are velocity, uncertainty or variance of the velocity, intensity, and evolution in 

10 time (i.e., the difference between display or transducer pixel values of two successive 

1 1 fi-ames for the same display or transducer pixel). Threshold modes 824 and 922 of FIGs. 

12 8 and 9 may set the thresholds for not displaying a display pixel because the display pixel 

1 3 or its corresponding transducer pixels are too dim or too uncertain. For example, when a 

14 signal is received, if its voltage or velocity, is below a threshold, its imcertainty or 

1 5 variance is greater than a threshold, the amount of change in its transducer or display 

1 6 pixels is greater than a certain threshold, or its width (i.e., its energy) is below a 

17 threshold, then the signal is not displayed. Altematively rather than having separate 

18 thresholds for each parameter such as voltage, velocity, energy, variance, aiid/or 

19 evolution in time a single threshold could be used for a fimction of any combination of or 

20 all of the parameters of the threshold criteria. These thresholds or others may be used in 

21 masks associated with filters of filter modes 1026 and 1 120, described below or other 

22 filters. 
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1 [1172] Frequency modes 708, 828 and 926 of FIGs. 8 and 9 are used for selecting the 

2 frequency of the transducer. Frequency modes 828 and 926 are used for color data 

3 acquisition. The transducer frequency may depend upon the characteristics of the 

4 transducer selected (the system may allow the user to change transducers) and the depth 

5 into the medium under investigation desired for imaging. Lower frequencies are used for 

6 imaging deeper into the medium under investigation. Conversely, higher frequencies are 

7 used for imaging to a shallow depth in the medium under investigation. Frequency 

8 modes 828 and 926 may be independent from frequency mode 708. Frequency mode 708 

9 may allow for selecting the frequency used for acquiring B-mode images independently 

10 of the frequency used in frequency modes 828. Altematively, the frequency chosen by 

1 1 frequency mode 708 may be linked to the frequency used in frequency modes 828 and 

12 . 926. The frequency of one of these modes may be automatically altered to be the same as 

13 or a function of the frequency of one or both of the other two frequency modes. 

14 Similarly, frequency modes 828 and 926 may be independent or linked to one another. 

15 [1173] Flash suppression modes 834 and 932 filter out high frequency noise, which 

16 has a tendency of causing a flash to be displayed. The flash suppression could be 

17 accomplished with a low pass filter having a high cutoff frequency so as to pass most of 

1 8 the frequency spectrum. Li an embodiment, flash suppression modes 834 and 932 can 

19 only be adjusted through the system defaults mode 406 (FIG. 4). Altematively, flash 

20 suppression modes 834 and 932 can also be adjusted during their respective imaging 

21 modes. 

22 [1174] Cursor modes 1002, 1 102, and 1202 determine the cursor used to indicate the 

23 region on a B-mode image that a set of data from a point (e.g., PW Doppler and CW 
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1 Doppler data) or strip is being taken. For example, the cursor may be used to outline and 

2 thereby create an ROI or to size an ROI. The cursor may be used to draw an additional 

3 line along which Doppler data is taken. The portion of the line that is within the ROI 

4 . may be the portion of the line used for collecting the Doppler data. Altematively, 

5 positioning the cursor over a point of the ultrasound image, and then clicking on that 

6 point may cause the ultrasound system 100 to gather and/or display Doppler data at the 

7 corresponding point of the medium under investigation. The cursor may be used to 

8 position and/or select annotations, graphs, the axis of a graph, and/or to change the range 

9 of the scale of an axis. Cursor modes 1002, 1 102, and 1202 may be used in combination 

10 with measure and annotate mode 312, discussed further below (FIG. 15) and/or with 

1 1 freeze mode 614 (FIGs. 6, 13 and 14), to define the ROI or trace or in combination with 

12 annotate mode 1304 (FIG. 13), for example. An example of a trace and ROI are 

1 3 illustrated in FIG. 26 A and is discussed below .The cursor may differ according to the 

14 mode. 

15 ^ [1175] In addition to cursor's positioning and selecting functions, the cursor is an 

16 active GUI object used to communicate a message to the user througji the cursor shape 

1 7 and color, for example. An example of a cursor shape is that of an arrow. If the cursor 

1 8 shape is an arrow, then when the location of the cursor is a valid location, e.g., within an 

19 ROI, its color may be green. Outside the ROI the cursor color may be red. Other cursor 

20 shapes may be used for other types of messages. For example, 

21 [1176] a) an hour glass may be used to tell the user that the system is busy, 

22 [11 77] b) a question mark may be used to indicate that a help function is available for 

23 a particular area of the screen or screen object, 
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1 [1 1 78] c) a stop sign may be used to indicate that by selecting that position the user 

2 can cancel an ongoing operation. 

3 [1 1 79] This list is not a limitation of the invention. Other cursor shapes and colors 

4 may be used to communicate context dependent availability of functions and messages. 

5 [1180] Display format modes 1008, 1 108, and 1206 allow the user to arrange the 

6 determine which plots are displayed during PW Doppler mode 608, CW Doppler mode 

7 610, and M-mode 612, respectively, and where on the screen each plot should appear. 

8 Display format modes 1008, 1 108, and 1206 may also allow the user to format the 

9 individual plots and to choose the type of plot used to show the data. 

10 [1181] Update on/off modes 1018 and 1116 automatically refresh and/or update their 

1 1 respective images when update on/off modes 1018 and 1 1 16 are on, but do not when 

1 2 update on/off modes 1018 and 1116 are off. In an embodiment update on/off modes 

13 1018 and 1116 only affect their respective imaging modes (i.e., update on/off mode 1010 

14 affects only PW Doppler mode imaging update on/off mode 1116 affects only B-mode or 

1 5 C W Doppler imaging). In another embodiment update on/off modes 1018 and 1116 

16 affect any one of, any combination of or all of the imaging modes individually or as one 

17 or more groups of modes. In an embodiment, update on/off modes 1018 and 1116 may 

1 8 turn on and/or off a simultaneous updating of the B-Mode image while Doppler 

19 information is being processed. Although updating the B-mode imaging may aid in 

20 visualizing and/or understanding the region of interest where the PW Doppler or CW 

21 Doppler information is collected, it also decreases the speed of PW or CW processing. 

22 Consequently, update on/off mode 1018 and 1116 may allow the user to choose between 

23 the added Doppler information or faster processing of CW or PW information. 
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1 [1182] Sweep speed modes 1022, 1 1 12, and 1208 controls the speed at which the 

2 signal sweeps across the screen and/or the speed of scanning the medium under 

3 investigation. 

4 [1183] Filter modes 1026 and 1 120 allow the user to apply various filters either 

5 during data acquisition and/or while viewing the data. For example, filters that smooth 

6 the data, high pass, low pass, and notch filters may be used to filter out noise or data that 

7 is not of interest. Filter modes . 1026 and 1 120 may also allow the application of and/or 

8 the setting of filters of an edge enhancement mode such as edge enhancement modes 728, 

9 826,924, 1028, 1122, and 1212. 

10 [1184] One form of filter that may be provided in filter modes 1026 and 1 120 is a 

1 1 series of three masks. The first mask filters out any display pixel elements associated 

12 with one or more parameters (e.g., energy, velocity, voltage, and/or one over the 

13 variance) below a certain threshold. For example, a 1 is assigned to the display pixels 

14 that are above the threshold, and a 0 to display pixels below the threshold. The second 

1 5 mask is the first mask after smoothing (e.g., averaging the product of each display pixel , 

16 value and its 1 or 0 with that of its nearest neighbor display pixels). The third mask is the. 

1 7 second mask with all elements having values below a certain threshold removed. The 

18 difference between the first mask and the third mask gives the high firequency elements 

19 that changed values as a result of the extra smoothing and masking in producing the third 

20 mask. For example, a 1 is assigned to the display pixels that are above the threshold and 

21 not removed, and a 0 to display pixels below the threshold that were removed. Then the 

22 raw velocity values are assigned to those display pixels that are in both the first and third 

23 mask, while a smoothed velocity value is assigned to those display pixels that were in the 
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1 first mask, but not the third mask. The smoothed velocity value associated with a display 

2 pixel may be the average of the raw velocity value of that pixel and the velocity values of 

3 the nearest neighbor display pixels, for example. 

4 [1185] Using these three filters it is possible to produce a more accurate image of a 

5 region having both high fi'equency spectral components (e.g., blood flow) and low 

6 firequency spectral components (e.g. organ or blood vessel movement). The user may be 

7 presented with options to choose the thresholds associated with these masks in the filter 

8 modes 1026 and 1 120 and/or in the threshold modes 824 and 922 and/or whether or not 

9 to use such a filtering technique. In an embodiment, filter modes 1026 and 1 120 can only 

10 be adjusted through the system defaults mode 406 (FIG. 4). Alternatively, filter modes 

1 1 1026 and 1 120 can also be adjusted during their respective imaging modes. 

12 [1186] FIG. 14 shows the measure mode 1306 of the ultrasound system 100, having a 

13 set calipers mode 1402, a set area mode 1404, a set trace mode 1406, and a display 

14 measured results mode 1408. 

15 [1187] The set calipers mode 1 402 may include several different types of calipers for 

16 performing measurements of distance, velocity, firequency, and time, for example. Also, 

17 set area mode 1404 may include defining areas of different set shapes such as circles, 

18 ellipses, squares, rectangles, triangles, and/or polygons that the user may choose fi*dm. 

19 Set area mode 1404 may include tools for defining arbitrary areas such as with a real or 

20 virtual stylus or by using combinations of arcs, curvilinear lines, and straight lines. Set 

21 trace mode 1406 allows the user to determine an arbitrary trace along which a 

22 measurement might be made. Display measured results mode 1408 allows the user to 

23 display the results of one or more calculations in tabular and/or graphical format and/or 
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1 as annotations on an image, for example. The user may be able to customize the tabular 

2 fomiat or graphical format as desired. 

3 [1188] FIG. 15 shows the measure and annotate mode 312 of the ultrasound system 

4 100, having a measure mode 1502 for taking measurements on an image, a calculation 

5 mode 1 504 for calculating various parameters that can be derived from the data such as 

6 those used for diagnosing a patient, and an annotate mode 1506 for recording user input 

7 information.^ 

8 [11 89] Measure mode 1 502 performs the measurements described above in 

9 coimectioh with FIGs. 13 and 14 regarding measurement done on a frozen image. The . 

10 difference between the measurements and annotations of FIGs. 13 and 14 and that of 

1 1 FIG. 15 is the path taken to get there, and that the measurements of FIGs. 13 and 14 may 

12 be taken during data acquisition. In FIGs. 13 and 14, the user first decided to freeze.the 

1 3 image by entering freeze mode 614 (possibly while taking data) and then afterwards 

14 decided to take measurements on it. In contrast; in FIG. 15 the user first decided to take 

15 measurements in measure and annotate mode 312 on images already acquired. For 

16 example, after the images were acquired, possibly by a technician, the images may have 

17 been stored away without being fiirther analyzed by a physician. Then, at a later time, 

18 the stored images may be displayed on the screen for analysis by the physician. The 

19 physician may use the measure mode 1502 to measure distances between or sizes of 

20 objects, for example. 

21 [1190] Calculation mode 1504 will be fiirther described in connection with FIG. 16. 
22 . Annotation mode 1506 is the same as annotate mode 1304 describe in conjxmction with 
23 FIG. 13. 
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1 [1191] FIG. 16 shows the calculation mode 1504 of the ultrasound system 100, 

2 having distance calculations mode 1602, depth calculation mode 1604, circumference 

3 calculation mode 1606, area calculation mode 1608, cardiac calculation mode 1610, OB 

4 calculations 1612, arid GYN calculations 1614. 

5 [ 1 1 92] Distance calculations mode 1 602, depth calculation mode 1 604, circumference 

6 calculation mode 1606, and area calculation mode 1608 are used for calculating the 

7 distance, depth, circumference, and area, respectively, of a medium under investigation. 

8 Cardiac calculation mode 1610, OB calculation mode 1612, and GYN calculation mode 

9 1614 are used for making calculations conmionly made for cardiac, obstetric, and 

10 gynecologic examinations, respectively. The user may choose from a predetermined list 

11 of calculations to perform. Some calculations may be preformed automatically upon 

12 entering the specific type of calculation mode. Calculation mode 1504 is not limited to 

13 the specific set of calculation modes listed. Any combination of, any one of, all of and/or 

14 other specialized calculation modes may be included in the calculation mode 1 504. 

15 [1193] FIG. 17 shows the reporting mode 314 of the ultrasound system 100, having 

16 print image/data mode 1702 and reporting mode 1704. 

1 7 [1194] Print image/data mode 1 702 may cause an image and/or a set of data to be 

1 8 printed to a file and/or printer. The image and/or data may be downloaded to the printer 

19 and/or a server via a cable, and/or acoustical and/or electromagnetic waves traveling 

20 through air, for example. Reporting mode 1704 may automatically generate a completed 

21 insurance form or other type of report. Reporting mode 1704 may allow the user to 

22 choose the form of the report and may have word processing capabilities, which may be 

23 specialized for producing forms. 
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1 [1195] FIG. 18 shows a system services mode 318 of the ultrasoimd system 100, 

2 having battery function mode 1802, get help mode 1804, and diagnostic mode 1806. 

3 [1196] Battery function mode 1802 may be the same as battery function mode 414, 

4 which may be accessible by either first entering system configuration mode 304 or by 

5 entering system services mode 318. 

6 [1 197] The get help mode 1 804 generally provides the user with information about 

7 ultrasound system 100. The get help mode 1804 may be context sensitive. Get help 

8 mode 1804 may include producing call out balloons that indicate the fimction of a given 

9 icon, tab, and/or menu item. The user may also be able to access general help about 

10 using ultrasound system 100 that is not dependent upon the context. Get help mode 1804 

1 1 niay allow the user to keyword search and/or display pages and/or sections from a user's 

12 manual, for example. In an embodiment, get help mode 1804 provides an index to the 

1 3 user's manual. Get help mode 1 804 may be capable of interactively stepping the user 

14 through a procedure as the procedure is being performed. After each step the user 

15 performs, get help mode 1804 may provide the next step in the procedure automatically. 

16 [1 198] Diagnostic mode 1 806 performs diagnostics on the system and/or any one of, 

17 any combination of, or all of the components of ultrasound system 100 individually or 

18 collectively. For example, diagnostic mode 1806 may indicate if a component such as 

19 . the transducer system 110 is disconnected or malfunctioning. In an embodiment, 

20 diagnostic mode 1 806 may provide information about the capacity of the various 

21 components associated with configuration of ultrasound system 100 in use, such as how 

22 much memory is available or how many images can be stored. Diagnostic mode 1806 

23 may perform signal analysis to. determine whether the transducer. system 1 10 is or other 
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1 components are properly functioning. Diagnostic mode 1806 may have the capability to 

2 determine whether the transducer system 1 10 is operating at an appropriate frequency. 

3 [1199] FIG. 19 shows an embodiment 1900 of the ultrasound system 100 having 

4 monitor 1902, keyboard 1904, mouse 1906, computing system 1908, transducer system 

5 1910 and cables 1912. Monitor 1 902 has screen 1914, which may be touch sensitive or 

6 may be just for viewing. 

7 [1200] Transducer system 1910 includes an imaging ultrasound scan head having an 

8 array of transducer pixel elements used to transmit.ultrasound signals for data acquisition. 

9 Transducer system 1910 converts electrical signals into acoustic signals and acoustic 

10 singals into electric signals, for the purpose of transmitting and receiving the ultrasound 

11 information. 

12 [1201] Computing system 1908 may be responsible for setting up, processing, 

13 storing, and annotating information gathered from the transducer system 1910. The 

14 function of computing system 1908 may include image reconstruction, color flow 

15 estimation, and Doppler computations, for example. Computing system 1908 may 

16 include laptop computer, a Personal Computer (PC) or be capable of performing many of 

17 or all of the functions associated with a PC or laptop computer. Computing system 1908 

1 8 may have an interface for transferring data to and/or from another system. 

19 [1202] ^ Computing system 1908 and/or transducer system 1910 processes the data 

20 collected and converts it into a format to be displayed on screen 1914 of monitor 1902. 

21 Computing system 1908 and/or transducer system 1910 is responsible for collecting and 

22 digitizing ultrasound data. Computing system 1908 and/or transducer system 1910 also 



55 



1 produces the signals to control and/or drive the transducers of the transducer array of 

2 transducer system 1910. 

3 [1203] The user interactions with computing system 1908 and/or transducer system 

4 1910 may be through buttons and/or keys of keyboard 1904, mouse 1906, and/or touch 

5 sensitive control areas on screen 1914. 

6 [1204] In an embodiment, screen 1914 may contain a representation of mouse 1906, 

7 buttons and/or keys of keyboards 1904, and/or of other buttons and/or control elements 

8 that can be activated by touching screen 1914. The buttons and/or keys represented on 

9 screen 1914 may additionally or altematively be activated by using mouse 1 906 or 

10 direction keys and an enter key of key board 1904 to navigate a cursor and/or an 

1 1 indication of a selection. Having a representation of mouse 1906, buttons, and/or keys on 
.12 screen 1914 may be useful for navigating GUI 208 and/or the ultrasoimd image when the 

13 image is presented on an external video monitor. Screen 1914 displays GUI 208, which 

14 may have views of fixed formats and/or may give the user the option to retile or rearrange 

15 the windows of the GUI 208 on screen 1914 in any fashion desired. 

16 [1205] The keys and/or buttons of keyboard 1904, GUI 208 and/or the cursor of 

17 mouse 1906 may be inteUigent and interactive and may change their function according 

18 to the context, Wstbry, and/or state of embodiment 1900. 

19 - [1206] Transducer system 1910, computer system 1908, and/or monitor 1902 may be 

20 battery-operated. 

2 1 [1207] Embodiment 1 900 may have one or more on/off switches and/or one or more 

22 microphones as one or more separate stand alone units and/or incorporated in any one, 

23 any combination of, or all of, computing system 1908, transducer system 1910, monitor 
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1 1902, keyboard 1904, and/or mouse 1906. The microphone may be used for voice 

2 activation of all of or any part of GUI 208 to control embodiment 1900. 

3 , [1208] If monitor 1902 is not touch sensitive, then monitor 1902 part of output 

4 system 102 (FIG. 1). If monitor 1902 is touch sensitive, then monitor 1902 is part of 

5 input/output system 114 (FIG. 1). Keyboard 1904 and mouse 1906 are part of input 

6 system 104 (FIG. 1), and are used to input text and/or select menu items, icons, virtual 

7 tabs and/or virtual buttons, for example. Computing system 1908 includes processing 

8 system 108 and memory system 106 (FIG. 1). Transducer system 1910 is part of 

9 transducer system 110, and is used for transmitting ultrasound signals to a medium under 

10 investigation such as a human body. 

1 1 [1209] Cables 1912 are an einbodiment of communications system 1 12. Cables 1912 

12 , communicatively link transducer system 1910, keyboard 1904, monitor 1902, computing 

13 system 1908, and mouse 1906. Cables 1912 may be wires and/or fiber optic cables, for 

14 example. Alternatively, transducer system 1910, keyboard 1904, monitor 1902, 

15 computing system 1908, and/or mouse 1906 may be communicatively linked without 

16 cables by using radio waves, for example. 

17 [1210] Keyboard 1904 will be discussed further after the discussion of FIG. 21. 

18 [1211] FIG. 20 shows an operation mode 2000 for system 2002, which is of an 

19 embodiment of the ultrasound . system 100. Ultrasound system 100 has imaging unit 

20 2004, display and control unit 2006, and docking unit 2008. Imaging unit 2004 includes 

21 imaging module 2010 and transducer module 2012. Display and control unit 2006 

22 includes two parts which are (1) handle 2014 having buttons 2016 and (2) monitor 



1 module 2018 having screen 2020 displaying GUI 208. Operation mode 2000 uses hands 

2 2022 and 2024. Hand 2022 has thumb 2026. 

3 [1212] Ultrasound system 100 has an operation mode 2000 of a handheld device that 

4 can be operated with either hand. Ultrasound system 100 may be any type of handheld 

5 ultrasound imaging unit, such as that of U.S. Patent Number 6,251,073 Bl. One hand 

6 2024 holds imaging module 2010 which may include an transducer module 2012, while 

7 the other hand 2022 holds the display and control unit 2006 by handle 2014. In such a 

8 situation, where one hand 2024 is used for imaging, it is desirable for the user to be able 

9 to use the other hand 2022 to hold and/or operate the display and control unit 2006. In an 

10 embodiment, buttons 2016 are arranged on handle 2014 of display and control unit 2006 

11 in such a fashion that thumb 2026 can conveniently operate buttons 2016. As an example 

12 of this embodiment, buttons 201 6 may be arranged in a circular or symmetrical pattern. 

13 In another embodiment, buttons 2016 may be arranged in any pattern, 

14 [1213] The display and control unit 2006 may be responsible for setting up, 

15 displaying, processing, storing, and annotating information gathered from the imaging 

16 unit 2004. The function of diplay and control unit 2006 may include image 

17 reconstruction, color flow estimation, and Doppler computations, for example. Display 

1 8 and control unit 2006 may include a Personal Digital Assistant (PDA) or be capable of 

19 performing many- of or all of the functions associated with a PDA. Imaging unit 2004 

20 and display and control unit 2006 may be battery-operated, and screen 2020 on display 

21 and control unit 2006 may be touch sensitive. Handle 2014 is for holding display and 

22 control unit 2006. The user interactions with display and control unit 2006 may be 

23 . through buttons 2016 on handle 2014 and/or touch sensitive control areas on screen 2020. 
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1 In an embodiment, handle 2014 could be replaced with ai small keyboard or panel having 

2 buttons 2016. Screen 2020 displays GUI 208, which may have views of fixed formats 

3 and/or may give the user the option to retile or rearrange the windows of the GUI 208 on 

4 the screen in any fashion desired. 

5 [1214] In an embodiment, screen 2020 may contain a representation of the buttons 

6 2016 or of other buttons and control elements, which can be activated by touching screen 

7 2020. Having a representation of buttons 2016 on screen 2020 may be useful for 

8 navigating GUI 208 and/or the ultrasound image when the image is presented on an 

9 external video monitor. 

10 [1215] In addition to a location for storing imaging xmit 2004, docking unit 2008 may 

11 be used for recharging imaging unit 2004 and display and control imit 2006. 

12 Alternatively, docking unit 2008 may also be used for downloading and/or uploading 

13 files to the display and control unit 2006 and/or for connecting display and control unit 

14 2006 to a network.. Alternatively, docking unit 2008 may be used for both recharging " 

1 5 arid uploading and/or downloading files. Docking unit 2008 may altematively be used to 

16 provide video interfaces like composite/SVHS video out (NTSC/ PAL) and SVGA video 

1 7 out for connecting to a PC monitor. 

1 8' [12161 In an embodiment, docking imit 2008 may be used to input an ECG Signal 

19 displayed in FIG. 26 B, Plot 2666. 

20 [1217] Imaging module 2010 processes the data collected and converts it into a 

2 1 format to be displayed on screen 2020 of display and control unit 2006. Imaging module 

22 2010 is responsible for collecting and digitizing ultrasound data. Imaging module 2010 



1 also produces the signals to control and/or drive the transducers of the transducer array of 

2 transducermoduie 2012. 

3 [1218] Transducer module 2012 includes an imaging ultrasoxmd scan head having an 

4 array of transducer pixel elements used to transmit ultrasound signals for data acquisition. 

5 Transducer module 2012 converts electrical signals into acoustic signals and acoustic 

6 singals into electric signals, for the purpose of transmitting and receiving the ultrasound 

7 information. 

8 [12191 Monitor module 201 8 and any means, such as docking unit 2008, of 

9 outputting information to a printer on other computer is part of output system 102 (FIG. 

10 1). Buttons 2016, screen 2020 (if touch sensitive), and any means of inputting data (e.g., 

1 1 patient information or images) from a computer system or database is part of input 

12 system 104 (FIG. 1). Imaging module 2010 and any processing and/or memory units 

13 with display and control imit 2006 are part of memory system 106 (FIG. 1) and 

14 processing system 108 (FIG. 1). Transducer module 2012 is part of transducer system 

15 110 (FIG. 1). The cables and/or means for communiciating through the air (using 

16 electromagnetic or sound signals) are part of communications system 112 (FIG. 1). 

1 7 [1220] By placing the screen 2020 and the transducer module 2012 on separate units 

1 8 held in separate hands, screen 2020 can be used to view the image being scanned in real 

19 time. Placing the buttons 2016 on the same unit as the screen. 2020 facilitates seeing the 

20 buttons 2016 and the screen 2020 simultaneously so that the user knows the function of 

21 button 2016 being pressed while viewing the effects of the button. Placing imaging 

22 module 2010 in the same unit as transducer module 2012 allows the signal path from 
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1 imaging module 2010 to transducer module 2012 to be shorter and therefore less noisy 

2 than were imaging module 201 0 and transducer module 2012 on separate units. 

3 [1221] In one embodiment (not shown), however, the screen 2020 and buttons 2016 

4 are located in different units. Buttons 2016 could be placed on imaging unit 2004. 

5 ' Imaging module 2010 and transducer module 2012 do not have to be placed in the same 

6 unit. Imaging module 2010 could be placed in the same unit with screen 2020 and 

7 buttons 2016, or could be placed with only screen 2020, While buttons 2016 are on the 

8 same unit as only transducer module 2012. Alternatively, imaging unit 2004 and display 

9 and control unit 2006 could be placed together in one unit. The invention is not limited 

10 to a handheld system. Display and control unit 2006 could be replaced with an appliance 

1 1 that is not handheld such as a laptop computer, personal computer, workstation, or 

12 mainiframe computer, which may or. may not include imaging module 2010. The 

13 appliance that is not handheld (e.g., a computer) may be programmed to perform the 

14 functions of imaging module 2010. 

15 [1222] GUI 208 has many different views. In this specification, each view is a 

16 different combination of features, menu items, icons, and/or tabs. The word "view" is to. 

1 7 be understood as generic to a frame or page of GUI 208. 

1 8 [1223] System 2002 provides a user interface for a handheld imaging device. In 

19 order to accommodate holding and controlling the 4evice at the same time with one hand 

20 (e.g., hand 2022), GUI 208 is designed to be Used by one-hand and one-thumb operation, 

21 and makes use of several intelligent (adaptive and context sensitive) active elements, e.g., 

22 windows, soft buttons, tabs, menus, toolbars, and/or icons. 
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1 [12241 In one embodiment, GUI 208 interface is voice controlled. To facilitate use 

2 with one hand, the user can train the device to recognize a set of words or combinations 

3 of words. Each recognizable unit (word or word combination) can be assigned to a 

4 device command, performing a specific function or a sequence of functions. Thus, some^ 

5 or all functions can be voice activated obviating or partially obviating the use of hand 

6 controls. 

7 [1225] FIG. 21 shows buttons 2016 on display and control unit 2006 of ultrasound 

8 system 100. In an embodiment, buttons.2016, which are made accessible to the User on 

9 display and control unit 2006, may include a start/stop toggle 2102, a back/escape button 

10 . 2 1 04, a save button 2 1 06, a first programmable button 2108, a second programmable 

1 1 button 21 10, a print button 21 12, a select or enter button 2114, and a direction button \ 

12 21 16. Direction button 2116 has a right arrow 2118, a down aitow 2120," a left arrow 

13 2122 and an up arrow 2124. - 

14 [1226] The buttons and toggles may be multifunctional. For example, start/stop . 

15 toggle 2102 may be replaced with or double as a freeze/unfreeze toggle. Start/stop toggle 

16 2102 toggles between two states start and stop or freeze and unfreeze; While in or upon 

1 7 being placed into the start or unfreeze state a process may be activated, allowed to • 

1 8 continue to operate, or screen 2020 may be allowed continue to display a series of 

19 images. While in or being placed into the stop or freeze state a process may be stopped 

20 temporarily, shutdown, or the screen 2020 may be hejd frozen oh one image. 

2 1 [1227] Back/escape button 2 1 04 returns screen 2020 to a prior view or frame of GUI 

22 208 or may be configured to exit a process in progress. Save button 2106 may be 
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1 configured so that it saves an image to a file or saves data (e.g., a patient's profile) that 

2 was entered, for example. 

3 [1 228] First programmable button 2 1 08 and second programmable button 2110 can 

4 be programmed by the user to perform a user-defined fiinction. Altematively, the user is 

5 allowed to select a fimction fi'om a list of predefined fimctions and assign that fimction to 

6 one of the programmable keys. In an embodiment, the user may be allowed to program 

7 the programmable buttons to perform any desired fimction and also given a list of 

8 predetermined fimctions to choose firom that can be assigned to the programmable 

9 buttons. In another embodiment, a sequence of user actions can be recorded and 

10 allocated to a first programmable button 2108 and/or second programmable button 2110. 

1 1 The recorded sequence is started when the user presses the button. 

12 [1229] Print button 21 12 activates a print action. For example, print button 21 12 may 

13 activate a printer to print an image or data, such as a patient profile or report. The image 

14 or data rnay be transmitted to the printer by electromagnetic or sound waves traveling 

15 through the air or via a cable between a printer and ultrasound system 100, for example. 

16 Select or enter button 2114 may be used to select an icon, tab, selection, or file or may be ; 

1 7 used to enter data typed in at the start of or during the operation of a routine or program. 

1 8 Select or enter button 2114 and the direction button 2116 may be combined into a single 

19 control element. 

20 [1230] Direction button 21 16 can be used to navigate a selection between icons, tabs, 

21 text boxes, or to move a ciursor within a text box, for example. The movement direction 

22 of the cursor or the selection is determined by arrows 21 18, 2120, 2122, and/or 2124. 

23 Depressing an arrow moves the cursor or selection in the direction of the arrow. Left 
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1 arrow 2122 moves the cursor or selection to the left. Down arrow 2120 moves the cursor 

2 or selection down. Right arrow 211 8 moves the cursor or selection to the right. Up 

3 arrow 2124 moves the cursor or selection up. Direction button 2116 can be replaced with 

4 four direction buttons - one button for each arrow 21 18, 2120, 2122, and 2124. The 

5 selection and cursor movement up, down, right, and left may be actuated at a variety of 

6 speeds that may depend on the context of the action. For example, selecting menu items 

7 may be actuated at one speed, while moving a cursor may auto-repeat at continuously 

8 increasing speeds. Tactile feedback (feedback related to a person's sense of feeling) is 

9 integrated with the selection and movement , such that, for example, it may be more 

10 difficult to leave a selection than to move through different selections, In an 

11 embodiment, the time required to implement an action is used to coiivey a sense of tlie 

12 . action being more difficult to impleniented. By requiring a longer time to implement an 

13 action the user is given more opportunity to change her or his mind as to whether to allo>y 

14 the action to be completed. 

15 [1231] In an embodiment,; any one of, any two of, or all of display and control unit 

1 6 2006, imaging module 20 1 0, and docking unit 2008 may have its own on/off button. 

17 [1232] In an embodiment, GUI 208 provides for several buttons 2016 accessible with 

18 the thumb 2026 of hand 2022 holding display and control unit 2006. Although FIG. 21 

19 illustrates hand 2022 as a left hand and hand 2024 as a right hand either hand could be 

20 used for hand 2022 and hand 2024. In other words, buttons 2016 may be used by and/or 

21 made to be accessible to any finger of either or both hands. The number and fimctions of 

22 the buttons indicated in this embodiment are for exemplification purposes and do not 

23 constitute a limitation of the invention. 
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1 [1233] Some of buttons 2016 have fixed fiinctionality (hard buttons); i.e., buttons 

2 2016 with fixed functionaUty always activate the same system fiinction independent of 

3 the operation mode. For example, start/stop toggle 2102 (e.g., fi-eeze/unfi-eeze) may have 

4 a fixed fimction. Other of buttons, such as buttons 2016, may be used to position a cursor 

5 on the GUI 208 in the up, dovra, left, and right directions, such as direction arrows 2118, 

6 2120, 2122, and/or 2124. Select or enter button 21 14 may be used to activate the object * 

7 the cursor points to or to perform a certain system fiinction in accordance to the cursor's 

8 position. At least one button, such as back/escape button 2104, may automatically or 

9 manually perform a fiinctionality switch. Automatic fimctionality switches may depend 

10 system lOO's state (e.g., the present mode or modes in use, the history of which modes 

1 1 were used most recently, how much battery lifetime remains, and/or the history of which 

12 fiinctionality the user selected for that button). The two user programmable buttons, first 

1 3 programmable button 2 1 08 and second programmable button 2110, may also be 

14 programmed to switch fiinctions depending upon context. 

1 5 [1234] An auto-optimize button and/or an on/off button may also be placed on handle 

16 20 1 4 or elsewhere in addition to buttons 20 1 6 or in place of one of the buttons 20 1 6. In 

17 an embodiment, save button 2106 could be replaced with an auto-optimize button, and 

1 8 print button 2112 could be replaced by a print/save button that switches fimction 

19 depending on the context. For example, the print button 2112 may also fiinction as a save . 

20 button during imaging modes and as a print button during cine mode 1302 (FIG. 13). 

21 Whenever the user depresses the auto optimize button, the system settings may be 

22 automatically optimized in accordance with several parameters including the system 

23 state, the image content, and the type of application. 
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1 [1235] The invention is not limited to the specific arrangement of buttons 2016 

2 shown in FIGs. 20 and 21 . In addition to the arrangement depicted in FIGs. 20 and 21, 

3 any of the buttons 2 1 02-2 1 1 4 may have any of the functions associated with any of the 

4 other buttons 2016, or functions not herein discussed. Buttons 2016 could be arranged in 

5 rows and columns and/or arranged to form any shape, such as a rectangle, triangle or 

6 oval. Buttons 2016 could be replaced with keys on a keyboard. 

7 [1236] Returning to FIG. 19, any of one or group of keys and/or buttons of keyboard 

8 1904 may be assigned the functions of buttons 2016. For example, keyboard 1904 may 

9 have direction arrows that perform the same functions arrows 2118, 2120, 2122, and 

10 2124. Keyboard 1904 may have a print screen button that performs the same functions as 

11 a print/save button, as save button 2 1 06, or print button 2112. Keyboard 1 904 may have . 

12 a pause button that may function as start/stop toggle 2102. Keyboard 1904 may have a 

1 3 backspace button and escape button, which may share the functions of back/escape 

14 button 2104. In an embodiment one or both of the backspace and escape buttons may be 

15 able to perform all of the functions of back/escape button 2104. In an embodiment, 

1 6 keyboard 1 904 is specially designed for use with ultrasound system 1 00 and has buttons 

1 7 corresponding to buttons 2016. Keyboard 1904 may have one or more function buttons 

18 (e.g., F1-F12), any one of, any combination of or all of which may be programmable. 

19 Alternatively, any one of, any combination of or all the keys and/or buttons of keyboard 

20 1904 may be programmable. Any of the buttons of keyboard 1904 may be assigned the 

21 auto optimize function of the auto optimize button discussed in conjunction with FIG. 21. 

22 [1237] Although certain features and/or function of ultrasound system 100 may have 

23 been discussed in conjunction embodiment 1900 and not in conjunction with system 
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1 2002, system 2002 may also include those features and/or functions. Although certain 

2 features and/or function of ultrasound system 100 may have been discussed in 

3 conjunction system 2002 and not in conjunction with embodiment 1900, embodiment 

4 1900 may also include those features and/or functions. 

5 [1238] FIG. 22 shows an example of a menu tree 2200 according to the invention, 

6 having hard buttons 2202 including a power button 2204, freeze button 2206, store button 

7 2208, auto optimize button 22 1 0, tab/icon select sequences 22 1 2, back/escape button 

8 2214, enter/select button 2216, and user programmable buttons 2218, and item select 

9 button 221 9. Menu tree 2200 also includes image menu 2220, patient utilities menu 

10 2222, application presets menu 2224, and tools menu 2226. Image menu 2220 has B- 

1 1 mode menu 2228, M-mode menu 2230, color flow menu 2232, power Doppler menu 

12 2234, PW Doppler menu 2236, CW Doppler menu 2238, which in turn have B-mode 

13 menu items 2240, M-mode menu items 2242, color flow menu items 2244, power 

14 Doppler menu items 2246, PW Doppler menu items 2248, and CW Doppler menu item 

1 5 2250, respectively. Patient utilities menu 2222, application presets menu 2224, and tools 

16 menu 2226 include patient utilities menu items 2252, application presets menu items 

17 2254, and tools menu items 2256, respectively. 

18 [1239] Menu tree 2200 is an example of a menu tree for GUI 208 (FIG. 1) of 

19 . ultrasound system 100 corresponding to main operational modes 300 (FIG. 3). 

20 [1240] Hard buttons 2202 correspond to and may be identical to buttons 2016 (FIG, 

21 20). Power button 2204 could be an on/off button. Freeze button 2206 could be 

22 start/stop toggle 2102 (FIG. 21). Store button 2208 could be save button 2106 (FIG. 21), 

23 and may also function as a print button, depending on the context. User programmable 
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1 buttons 2218 could be the same first programmable button 2108 (FIG. 21) and second 

2 programmable button 2110 (FIG. 21). Enter/select button 2216 could be select or enter 

3 button 2114 (FIG. 21). Auto optimize 2210 may be the same as the optional auto 

4 optimize button that can be included in buttons 2016 and/or have the same function as 

5 nay of the auto optimize modes. Tab/icon select sequences 2212 are sequences of menu 

6 navigation operations followed by a select operation choosing a menu item. Tab/icon 

7 select sequences 2212 and/or item select button 2219 could be implemented by direction 

8 button 2116 (FIG. 21) having right arrow 2118, down arrow 2120, left arrow 2122 and up 

9 arrow 2124 for navigating through the menu items or icons on a view of the GUI 208 

10 (FIG. 2). Back/escape button 2214 could be the same as back escape button 2104. 

1 1 [1241] Among the menu items on the image menu 2220 are menu items that select B- 

12 mode menu 2228, M-mode menu 2230, color flow menu 2232, power Doppler menu 

1 3 2234, PW Doppler menu 2236, and CW Doppler menu, which are different imaging 

14 modes corresponding to B-mode 602, M-mode 612, color flow mode 604, Power Doppler 

15 mode 606, PW Doppler mode 608, and CW Doppler mode 610 (FIG. 6), respectively. 

16 The different modes of the display modes of FIGs. 7-13 may have a one-to-one 

17 correspondence with the B-mode menu items 2240, M-mode menu items 2242, color 

1 8 flow menu items 2244, power Doppler menu items 2246, PW Doppler menu items 2248, 

19 and CW Doppler menu item 2250, respectively^ 

20 [1242] Patient utilities menu 2222 corresponds to patient information mode 306 (FIG. 

21 3). 



1 [1243] Cardiology, obstetrics, gynecology, and radiology menu items of application 

2 presets menu items 2254 correspond to different types of users. The menu item general 

3 may allow for individual customizing of all or some presets. 

4 [1244] Menu items cine, annotation, and measurement of tools menu items 2256 

5 implement cine mode 1302, annotate mode 1304, and measure mode 1306 (FIG. 13), 

6 respectively. Setup menu item of tools menu items 2256 implements parts of system 

7 configuration mode 304 (FIG. 3). Startup panel menu item corresponds to system 

8 defaults mode 406 (FIG. 4) and is used for setting the startup display. Annotate 

9 dictionary menu item corresponds to define annotation dictionary mode 408 (FIG. 4). 

10 Exam configuration. menu item corresponds to assign presets mode 404 (FIG. 4). Site 

1 1 configuration menu item corresponds to set system defaults mode 406 (FIG. 4). 

12 Transducer defaults, archive defauUs, battery, ROI defaults, and reset configuration menu 

13 items may also be included in system defaults mode 406. Language menu item 

14 corresponds to language mode 416 (FIG. 4). Touchscreen calibration corresponds to . 

15 touchscreen calibration mode 410 (FIG. 4). Printer set up menu item corresponds to 

16 printer setup mode 412 (FIG. 4). 

1 7 [1245] FIG. 23 shows an embodiment of a main display view 2300 having image area 

18 . 2302, control area 2304. Control area 2304 has tabbed panel 2306 and sub-panel 2308. 

19 Tabbed panel 2306 has imaging mode tab 23 10, patient information tab 23 12, user 

20 defined jjresets tab 2314, and tools tab 2316, which correspond to the menu items 2220, 

21 2222, 2224, and 2226 (FIG. 22), respectively. Sub-panel 2308 has a selected imaging 

22 mode panel, which is B-mode control panel 2318, a menu of imaging modes 2320, and a 

23 menu of additional functions including an audio tab 2322, and cursor tab 2324. More 
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1 tabs can be added or configured by the user, such as a full screen tab. Cursor tab 2324 

2 activates a cursor in the image area 2302. Audio tab 2322 allows messages to be 

3 recorded. Ultrasound system 100 starts in B-mode ready for imaging. Sub-panel 2308 

4 may have a hide control button in place of or in addition to audio tab 2322, which hides 

5 the control area. B-mode control panel 2318 includes B-mode tab 2326, tissue harmonics 

6 tab 2328, gain tab 2330, depth tab 2332, more tab 2334, and retum to main mode tab 

7 2336. 

8 [1246] In an embodiment, the modes of operation accessible via GUI 208 are divided 

9 into four main categories by imaging mode tab 23 1 0, patient information tab 2312, user 

10 defined presets tab 23 14, and tools tab 2316. In an embodiment, imaging mode tab 23 10, 

1 1 patient information tab 2312; user defined presets tab 2314, and tools tab 2316 are 

12 accessible in every view of the control panel unless hidden by a window or in fiill screen 

1 3 mode 618 (FIG. 6), for example. Imaging mode tab 2310 allows a user to select an 

14 imaging mode and set the associated parameters. For example, a user could use imaging 

1 5 mode tab 23 1 0 to select B-mode menu 2228, M-mode menu '2230, color flow menu 2232, 

16 power Doppler menu 2234, PW Doppler menu 2236, or CW Doppler menu and thereby 

17 select the corresponding imaging mode. Selecting imaging niode tab 23 10 while viewing 

1 8 the B-mode imaging view, as in FIG. 23 would not affect a change because the default 

19 imaging view (e.g., B-mode) is already on screen 2020 or 1914. Selecting imaging mode 

20 tab 23 1 0 while viewing an operating mode other than the default imaging mode may 

21 cause the view to change to the default imaging mode. Altematively, selecting imaging 

22 mode tab 2310 while already viewing an imaging mode even though it is not the default 
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1 imaging mode will not cause any change in the display, because GUI 208 is already 

2 presenting an imaging mode. 

3 [1247] Patient information tab 2312 allows the user to enter patient specific data. 

4 User defiiied presets tab 2314 allows the user to select her or his preferences. User 

5 defined preferences may include, for example, the type of user (e.g., OB/GYN, 

6 cardiologist, or technician) the sets of measurements, calculations, and/or reports 

7 presented to the user and /or the mode of first view that appears upon powering up. Tools 

8 tab 2316 allows the user to access cine mode 1302, annotate mode 1304, measure mode 

9 1306, and/or setup other fimctions. B-mode control panel 2318 includes the menu items 

10 of the imaging mode selected. Menu of imaging modes 2320 provides a menu containing 

1 1 menu items that are each a different display mode. Audio tab 2322 allows audio 

12 messages to be recorded and/or played back. Cursor tab 2324 activates a cursor in the 

13 image area 2302. 

14 [1248] B-mode control panel 23 1 8 is activated upon selecting B-mode tab. Tissue 

15 harmonics mode 706 (FIG. 7), gain mode 702 (FIG. 7), and depth mode 704 (FIG. 7), are 

16 selected by selecting tissue hamionics tab 2328, gain tab 2330, and depth tab 2332, 

17 respectively. Selecting more tab 2334 accesses another set of B-mode menu items, 

18 causing them to appear on B-mode control panel 2318. Return to main mode tab 2336 

19 returns ultrasound system 100 to the system's default imaging mode. If ultrasound 

20 system 100 is akeady in its default mode, no change occurs. Although in this example 

21 tissue harmonics tab 2328 is just a menu item on the B-mode control panel 2318, it could 

22 be its own display mode. Similarly, any of the menu items could have its own display 

23 mode. 
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1 [1249] FIG. 23 represents an example of the first view that is presented to the user 

2 upon powering up ultrasound system 100. Consequently, FIG. 23 is in B-mode, because 

3 users often perform significant portions of their work in B-mode. However, ultrasound 

4 system 100 could have any mode instead of B-mode control panel 2318 upon powering 

5 up, depending upon how ultrasound system 100 is configured. 

6 [1250] In an embodiment, GUI 208 of FIG. 23 includes on screen 1914 or 2020 

7 several elements each of which may be active and/or intelligent elements. Those 

8 elements that are active have information processing capabilities that are a function of 

9 input, context, and history, for example. Intelligent elements have interactions between 

10 elements and between the user and the elements are auto-adaptive (i.e., the intelligent 

1 1 elements are automatically optimized depending on a number of parameters, including 

12 system state, user habits, etc.). Some examples of context dependent user interactions are 

13 selecting a patient's name may automatically open a patient information dialog window, 

14 and selecting a measurement result may automatically open a measurements summary 

1 5 page. Also, selecting a battery icon may open a window with details about the battery 

16 charge status including how much time of operation is still available. Another example 

17 of a context dependent user interaction is selecting the logo of the manufacturer of 

18 ultrasound system 100 may open up a window allowing the user to connect to the 

19 manufacturer's website via the Internet through, for example, a mini web browser 

20 available on ultrasound system 100. 

21 [1251] An embodiment of ultrasound system 100 is the combination of active and/or 

22 intelligent elements designed to facilitate one-hand and/or one-thumb controlled imaging. 

23 As an example, the tabbed panel 2306 on the top left hand side of the screen 
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1 representation of FIG. 23 can be selected by using right arrow 2118 and left arrow 2122 

2 or right and left direction buttons on keyboard 1904. The entries on one tab can be 

3 selected by using up arrow 2124 and down arrow 2120 or up and down direction buttons 

4 on keyboard 1904, for example. The icons audio tab 2322 and cursor tab 2324 on the 

5 toolbar on the bottom right hand side of the screen can be selected by navigating and 

6 selecting with right arrow 2118 and left arrow 2122 or right and left direction buttons on 

7 keyboard 1904, for example. Image area 2302 may be an active element.. Changing 

8 input focus from the left hand side tab to the right hand side image element can be 

9 achieved using a combination of right arrow 2 1 1 8 and left arrow 2 1 22 or right and left 

10 direction buttons on keyboard 1904, for example. 

1 1 [1252] In order to support the user in learning and operating ultrasound system 100, 

12 context sensitive help is provided. The help refers to either the ultrasound system lOO's 

13 fiinctionality or to the interpretation of image data, for example. 

1 4 [1253] In another embodiment, the user interface provides for random access to any 

15 of the active elements through a touchscreen. In the one-handed operation mode, the user 

16 can utilize the thumb or any other finger to "touch" and activate any screen elements. In . 

17 addition, a stylus or another pointing device can be used in a two-handed operation mode. 

1 8 [1254] In order to minimize the time for setting up and configuring the system, 

1 9 according to this invention, the user interface provides for application and/or user 

20 dependent presets, which are optimized based on several factors (e.g., user behavior, 

21 image quality, etc.). 
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1 [1255] FIG. 24 shows an embodiment of the main display view 2400 having battery 

2 status indicator 2402, temperature gauge 2404, thermometer 2406, control panel 2408, 

3 hide control tab 2410, and tabbed panel 2412. 

4 [1256] Battery status indicator 2402 shows how much energy or life remains in the 

5 battery. Battery status indicator 2402 is part of battery function mode 1 802 (FIG. 1 8). 

6 When the battery change reaches a predefined threshold, the system initiates an orderly 

7 and/or controlled shutdown operation including leaving specified data in non-volatile 

8 memory. Temperature gauge 2404 and thermometer 2406 indicate the temperature of the 

9 processing unit and/or the processor system 108 (FIG. 1). One or both of temperature 

1 0 gauge 2404 and thermometer 2406 may be supplemented or replaced with a nimierical 

1 1 representation of temperature, for example. Temperature gauge 2404 and thermometer 

12 2406 are part of diagnostic mode 1806 (FIG. 18). One or both of temperature gauge 2404 

13 and thermometer 2406 may provide the temperature of the ultrasound system 100. In this 

14 embodiment control panel 2408 has a hide control tab 2410. Hide control tab 2410 could 

15 be used to hide, all or any part of control panel 2408. Hide control tab 2410 may control 

16 which menu items appear on control panel 2408. In an alternative embodiment, control 

17 panel 2408 may have an audio tab instead of or in addition to the hide control tab 2410. 

1 8 The audio tab may activate and/or deactivate an audio input for navigating through the 

19 menus of GUI 208 and/or for inputting data in text fields when in report mode .314, for 

20 example. . Tabbed panel 2310 differs fi-om tabbed panel 2306 only in that the icoiis used 

21 on the tabs are different. No cursor tab is shown because there is no image. 

22 Alternatively, a cursor tab could be displayed even when there is no image. Optionally, 

23 ultrasound system 100 may be combined with a system for taking a patients temperature, 
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1 . in which case temperature gauge 2404 and/or thermometer 2406 may be used for 

2 displaying the temperature of the patient. Tabbed panel 2412 and 23 10 differ only in the 
.3 icons used for the tabs. 

4 [1257] FIG. 25 shows a view 2500 having a color flow control panel 2502, color flow 

5 tab 2504, Region Of Interest (ROI) position tab 2506, ROI size tab 2508, scale tab 2510, 

6 more tab 25 12, and return to main mode 25 14. View 2500 also has ROI 25 16. 

7 [1258] Color flow tab 2504 activates color flow control panel 2502. ROI position tab 

8 2506 and ROI size tab 2508 activate ROI mode 802 (FIG. 8) and ROI size mode 808 

9 (FIG. 8), which control position and size, respectively, of ROI 2516. Scale tab 2510 

10 activates scale mode 806. Selecting more tab 2512 causes an additional set of color flow- 

1 1 mode menu items to appear, similar to more tab 2334 (FIG. 23). Retum to main mode 

12 tab 2514 retums the ultrasound system 100 to the default imaging mode (e.g., B-mode 

13 602 of main display view 2300), similar to retum to main menu tab 2336 (FIG. 23). 

14 [1259] FIG. 26 A shows a view 2600 having a PW Doppler control panel 2602, PW 

15 Doppler tab 2604, gate setup tab 2606, gain tab 2608, B-mode controls tab 2610, color 

16 . flow controls 2612, and more tab 2614. View 2600 also has the Doppler line 2616, ROI 

17 2618, baseline 2620, and amplitude axis 2622, and sample volume or gate 2617 marked 

1 8 with a Z along the dotted line of sample volume or gate 261 7. 

19 [1260] The gate associated with view 2600 is the section along the Doppler line 2616 

20 in which data is gathered. The section of Doppler line 2616 over which data gathered is 

2 1 that part of Doppler line 26 1 6 that is within ROI 2618. The data gathered from the 

22 sample volume or gate 2617 defined by ROI 2618 and Doppler line 2616 may be plotted 

23 above basehne 2620 using amplitude axis 2622. Sample volume or gate 2617 may be an 

> 
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1 active graphic element or object. The gate position, size, aiid angle can be modified by 

2 selecting the appropriate menu items and changing the current menu values using the 

3 direction button 2 1 16 and select or enter button 2114 (FIG. 2 1 ) or direction buttons and 

4 enter button on keyboard 1904. The user can position a cursor over sample volume or 

5 gate 26 1 7 and select it using select or enter button 2 1 1 4 or enter button on keyboard 

6 1904. The size of the sample volume or gate 2617 can be modified graphically using 
- 1 right arrow 2118 and/or left arrow 2 1 22 of direction button 2 1 1 6 or right and/or left 

8 direction arrows of keyboard 1904, for example. The depth sample volume or gate 2617 

9 can be modified interactively and/or graphically using down arrow 2120 and/or up arrow 

1 0 21 24 of direction button 2 1 1 6 or up and/or down direction arrows of keyboard 1 904. The 

1 1 angle of the sample volume can be automatically adjusted by the system to obtain the 

12 maximum intensity signal and/or sharpest image. 

13 [1261] While PW Doppler tab 2604 is selected all color flow mode menu items and 

1 4 all M-mode menu item^ can be accessed using B-mpde controls tab 2610 and color flow 

15 controls tab 2612. PW Doppler tab 2604 activates PW Doppler control panel 2602. Gate 

16 setup tab 2606 controls the size, position, and angle of the sample volume or gate 2617 . 

1 7 for gathering data. Selecting more tab 2614 causes another set of P W Doppler mode 

1 8 menu items to appear, similar to more tab 2334 (FIG. 23). The retum to main mode tab 

1 9 can be accessed by selecting more tab 2614. Alternatively, a retum to main mode tab ^ 

20 could replace any one of the other tabs of PW Doppler control panel 2602. 

21 [1262] FIG. 26 B shows a view 2650 having CW Doppler mode 610 having a color 

22 flow image 2652 including line 2654 and ROI 2656. View 2650 also includes plots 2664 

23 and 2666 sharing a vertical axis 2660. Plot 2664 has horizontal axis 2658, and plot 2666 
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1 has horizontal axis 2662. Control area 2665 has mode select region 2667 and panel 2668. 

2 Panel 2668 includes new patient tab 2670, application preset tab 2672, tools tab 2674, 

3 hide control and/or audio tab 2676, save tab 2678, and stop tab 2680. 

4 [1263] The information used for plots 2664 and 2666 may be gathered from the gate 

5 defined by the portion of line 2654 subtended by ROI 2656. Plot 2664 displays spectral 

6 information using the horizontal axis 2658 for frequency and the vertical axis for 

7 amplitude. Plot 2666 is an Echo Cardio Gram (ECG) signal used to monitor heart 

8 activity and to synchronize ultrasound acquisition with heat movements. 

9 [1264] Control area 2665 represents a different embodiment than control area 2304 

10 (FIG. 23) having a different mixture of icons and tabs. Panel 2668 replaces tabbed panel 

1 1 2306 (FIG. 23). New patient tab 2670 corresponds to new patient mode 504 (FIG. 5) and 

12 will be discussed further in connection with FIG. 27. Application preset tab 2672 

13 corresponds to assign preset mode 404 (FIG. 4) and application presets menu items 2254 

14 (FIG. 22). Tools tab 2674 corresponds to tools mode 320 (FIG. 3) and to tools menu 

15 items 2256 (FIG. 22). Hide control and/or audio tab 2676 corresponds to hide control tab 

16 2410 (FIG. 24). Save tab 2678 allows the user to save the image and/or the data gathered 

17 to a file, similar to save button 2 1 06 (FIG. 2 1 ) or a corresponding button on keyboard 

18 1 904. Stop tab 2680 may be used to stop the data acquisition and/or freeze the image 

1 9 similar to start/stop toggle 2 1 02 (FIG. 2 1 ) or pause button on keyboard 1 904, for 

20 example. 

21 [1265] FIG. 26C shows a view 2682 having maps tab 2683 selected and power 

22 Doppler tab 2685 selected showing mapping controls 2684 which in tum has points 

23 2686a-f and lines 2688a-f 
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1 [1266] In an embodiment, although mapping controls 2684 of FIG. 26C cover only 

2 part of a side panel, mapping controls 2684 may be a dedicated user interface window 

3 that covers the entire screen, for example. The user can input any mapping curve through 

4 mapping controls 2684. The user can adjust the horizontal position of each of the points 

5 2686a-f by using the left arrow 2122 and right arrow 2118 (FIG. 21) or left and right 

6 direction buttons of keyboard 1904. The user can select any of the points 2686a-f by 

7 using the up arrow 2124 and down arrow 2120 (FIG. 21) or up and down direction 

8 buttons of keyboard 1904. Altematively, points 2686a-f can be moved by clicking and 

9 dragging using a mouse 1906 (FIG. 19), finger, and/or stylus. 

10 [1267] Each horizontal position along lines 2688a-f corresponds to a level of 

1 1 magnitude between a Minimum (MIN) and Maximum (MAX) level. There can be more 

1 2 or less than six points 2686a-f and lines 2688a-f 

13 [1268] FIG. 27 is an example of a new patient view 2700 of the GUI 208 for entering 

1 4 information for a new patient having tabbed panel 2306 with imaging mode tab 23 1 0, 

15 patient information tab 23 12, user defined presets tab 23 14, and Tools tab 23 16, similar 

16 to FIG. 23. New patient view 2700 also has patient information panel 2702 and patient 

17 information area 2734. Patient information panel 2702 has new tab 2704, add tab 2706, 

18 report tab 2708, archive tab 2710, print tab 2712, and help tab 2714. Patient information 

19 area has name box 2716, ID box 2718, birthdate box 2720, gender selection 2722, height 

20 box 2724, weight box 2726, operator box 2728, referring physician box 2730, and 

21 comment box 2732. 

22 [1269] New tab 2704 is for changing which patient's information is being displayed, 

23 designating a different patient abready in the system or adding a different patient not 
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1 already in the system. Add tab 2706 is for adding a new patient to the database. Report 

2 tab 2708 is for producing a report such as a medical report for an insurance company. 

3 Report tab 2708 corresponds to reporting mode 1704 (FIG. 17). Archive tab 2710 is for 

4 sending patient information to storage. Upon pressing archive tab 2710 ultrasound 

5 system 100 may decide upon a classification for the patient and an optimum location or 

6 set of locations to store the patient information. The classification for the patient may . 

7 depend upon the patient's disease, place of origin, physical features, age, physician 

8 and/or location in a hospital, for example. Print tab 2712 is for printing the current view 

9 or the report and corresponds to print image/data mode 1702 (FIG. 17). Help tab 2714 is 

10 for obtaining help about any topic or may be for obtaining help about using the view 

1 1 being displayed. Help tab 2714 corresponds to get help mode 1804 (FIG. 18). Name box 

12 2716, ID box 2718, birthdate box 2720, gender selection 2722, height box 2724, weight 

13 box 2726, operator box 2728, referring physician box 2730, and comment box 2732 are 

14 for entering or editing the new patient's name, identification, birthday, gender, height, 

1 5 weight, operator, referring physician, and comments, respectively, and are contained 

16 within patient information area 2734. The identification may be a social security number 

17 or a number assigned by the institution examining the patient. The operator may refer to 

1 8 the user taking or entering the data. The dotted box around gender selection 2722 is not 

19 part of the GUI 208, but was added to clarify which items are being referred to by the 

20 * designation gendet selection 2722. The text boxes 2716-2732 correspond to the menu 

21 items under the new patient menu item in patient utiUties menu items 2252 (FIG. 22). 

22 [1270] All the text fields of the patient information area 2734 (e.g., the name box 

23 2716 or the "Date and Time" fields such as birthdate box 2720) may be active elements. 
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1 They can be selected using the buttons, and once selected they show active and/or 

2 intelligent behavior. In an embodiment, entries can be made to any of the text boxes of 

3 patient information area 2734 using voice recognition and/or free hand writing with a 

4 stylus for example and automatic character recognition. For example, selecting the 

5 birthdate box 2720 allows the user to enter the patient's birth date using any available 

6 means such as a virtual keyboard (e.g., keyboard 2800, FIG. 28 to be discussed below), 

7 voice recognition, or free hand writing. Altematively, given sufficient other information 

8 ultrasound system 100 will find the birth date in the database and fill in birthdate box 

9 2720. Selecting the name box 2716 can open the database interface and retrieve the 

1 0 corresponding patient ' s records. 

1 1 [1271] In an embodiment, new patient view 2700 as well as other views are 

12 configured to optimize one-hand and one-thumb operations. The patient information 

13 panel 2702 is a database interface and is configured such that database fields are 

1 4 selectable .using the left arrow 2 1 22, right arrow 2 1 1 8, up arrow 2 1 24 and down arrow 

15 2120. The navigation interface with its hierarchical structure provides for up and down 

16 navigation at the same level in the hierarchy and left right navigation to move between 

17 hierarchy levels. Thus left arrow 2122 may function like a return to the previous menu, 

18 escape or back tab, and right arrow 2118 may fimction like a forward tab or a selection of 

19 a menu item bringing the GUI 208 to the next menu. The same multifiinctional concept > 

20 applies to all hierarchically structured active elements. Although not necessarily suitable 

21 for one-handed operations embodiment 1900 may be configured such that the direction 

22 buttons of keyboard 1904 have the same navigation and selection fimctions as arrows 

23 21 18, 2120, 2122, and 2124 described above. 
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1 [1272] FIG. 28 is an example of the new patient view 2700 partially hidden by a 

2 virtual keyboard, keyboard 2800. The components of new patient view 2700 are the 

3 same as in FIG. 27. Keyboard 2800 has keys BS key 2802, X key 2804, exit/back key 

4 2806, recg key 2808, lock key 2810, shift key 2812, OK key 2814 and as well as other 

5 typical keyboard keys that are not labeled, for example. Other virtual keys may be added 

6 as appropriate. For example, a new patient virtual shortcut key may be. added to 

7 keyboard 2800, which may have the same fiinction as new tab 2704 (FIG. 27). As 

8 another example, keyboard 2800 may include a key labeled search for searching a 

9 database. 

10 [1273] BS key 2802 is a backspace key. X key 2804 is an exit key for closing 

1 i keyboard 2800. Exit/back key 2806 is for exiting a view or an application or for going 

12 back to the previous view or frame. Recg key 2808 is for enabling a recognitions 

13 function. Recg key 2808 may enable, for example, ultrasound system 100 to fill in 

14 remaining fields in new patient view 2700 after one or some of the boxes have ahready 

1 5 been filled in. Similarly, Recg key 2808 could enable a word match or word complete 

16 feature, which could complete partially typed or entered words with the closest match in 

17 the database. Lock key 28 1 0 is used in combination with other keys such as shift key 

18 2812 for a caps lock. Lock key 2810 could also be used for number lock, for example. 

19 In an embodiment, lock key 2810 can be used with recg key 2808 so that the user never 

20 needs to finish entering a word, name, or field if ultrasound system 100 can locate it first. 

21 [1274] In an embodiment, a virtual keyboard (keyboard 2800) is provided in order to 

22 facilitate one-handed and/or potentially one-thumb alphanumeric data entry. The user 

23 can select any alphanmneric key on the keyboard by using the left arrow 2 122, right 
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1 arrow 21 18, up arrow 2124, and/or down arrow 2120. Select or enter button 21 14 may 

2 have the same effect as the enter key of the keyboard. Although not necessarily suitable 

3 for one-handed operation the direction buttons and enter button of keyboard 1904 may be 

4 used to navigate and select the keys of virtual keyboard 2800 similar to the way arrows 

5 2118, 2120, 2122, and 2124 and enter button 21 14 are used. Alternatively, pressing a key 

6 or button on keyboard 1904 may activate a corresponding key on virtual keyboard 2800. 

7 [1275] FIG. 29 is a page of a selected patient's report 2900 having patient 

8 information tables 2902 and patient information panel 2702 having back tab 2904, search 

9 tab 2906, and review tab 2:908, (not present in previous FIGs.) in addition to having new 

10 tab 2704, add tab 2706, report tab 2708, print tab 2712, and help tab 2714 aheady 

1 1 described in connection with FIG. 27. 

12 [1276] In the view of the embodiment shown in FIG. 29 patient information tables 

13 2902 are specialized for an OB/GYN examination, but could be specialized for any type 

14 of user or customized for a particular user. Back tab 2904 brings ultrasound system 100 

15 back to new patient view 2700. Search tab 2906 allows the user to search through . 

16 ultrasound lOO's database. For example, search tab 2906 may allow the user to search 

17 any one of, any combination of, or all of the record of the patient whose report is being 

18 viewed, search through the database for a specific person's report, and/or search for text 

19 in a field of all reports or a subset of reports of the database. Review tab 2908 may be 

20 used to allow the user to review data already entered into ultrasound system 100, a related 

21 database, or an unrelated database. For example, review tab 2908 may be used to allow 

22 the report to be edited and/or the rest of the report to be reviewed. 
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1 [1277] FIG. 30 shows a view 3000 for selecting a new patient having selection table 

2 3002, control panel 3004, edit tab 3006, delete tab 3008, and view tab 3010. 

3 [12781 Control panel 3004 is essentially the same as sub-panel 2308 except that 

4 different icons are used. In view 3000 tabs are presented that are associated with word 

5 processing features of ultrasound system 100. Edit tab 3006 allows the user to edit a 

6 patient's records. Delete tab 3008 allows the user to delete a patient's records. View tab 

7 3010 allows the user to view the patients in ultrasound system lOO's records or another 

8 system's records. In an embodiment, selection table 3002 can be accessed by selecting 

9 review tab 29 (FIG. 29). 

10 [1279] FIG.31 Ashowsaview3100Aofthetoolspanel3102havingprinttab2712 

1 1 and help tab 2714, similar to FIG. 27, and also having cine tab 3104, measure tab 3106, 

12 . annotate tab 3108, setup tab 3110, screen configuration icon 3112, exam presets icon* 

13 3114, annotation dictionary icon 3116, transducer icon 3118, ROI defaults icon 3 1 20, 

1 4 save options icon 3122, printer icon 3 1 24, touchscreen icon 3 1 26, battery icon 3128, 

1 5 system defaults icon 3130, date/time icon 3132, and language icon 3 1 34. 

16 [1280] Although not shown, additional operational icons inay be included in a start up 

17 panel. For example, an export/import or upload/download icon, a reset configuration 

18 icon, an ROI defaults icon, and/or a battery icon may be included in the icons of the start 

19 up panel associated ^yith setup tab 3 1 1 0. The series of icons 311 2-3 1 34 are displayed 

20 upon selecting setup tab 3110. Screen configuration icon 3112 allows the user to 

21 configure the screen by changing its colors, locations of the control area and/or image 

22 area and/or otherwise retile the display. Screen configuration icon 3112 may also control 

23 which items appear in the start up panel. The type and position of the information 
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1 displayed on the screen, e.g. menu items, measurement results, etc., can be customized 

2 and included in a preset. Icons 3 1 1 2-3 1 34 have a one-to-one correspondence with the 

3 menu items under setup in tools menu items 2256. 

4 [1281] FIG. 3 1 B shows a view 3 100 B having measure menu item selected. 

5 Distance may be calculated along lines 3 146, which were drawn by the user. 

6 [1282] Each line 3146 is an active GUI object, and can be selected, deleted, 

7 repositioned, and resized using select or enter button 2114, up arrow 2124, down arrow 

8 2120, left arrow 2 1 22, right arrow 2 1 1 8, and back /escape button 2 1 04 or the direction, 

9 escape, and/or backspace buttons of keyboard 1904, for example. The each line 3146 is 

10 associated with context information; e.g., each line behaves differently if other lines are 

1 1 present or according to the type of calculation the user indicates she or he wants to 

12 perform. Depending on the application, for example, a ratio between the two distances 

13 may be output and automatically calculated each time one of the two lines is modified. 

14 Alternatively, the system may assist and/or instruct a user in a step-by step interactive 

15 process in order to perform a sequence of measurements required by a more complicated 

1 6 calculation of a clinically relevant parameter. 

17 [1283] FIG. 3 1 C shows an embodiment with video-like controls including tools 

1 8 panel 3 1 02 having cine tab 3 1 04 selected having video control bar 3 1 59 including single 

1 9 step backward 3 1 60, backward playback 3 1 62, fast rewind 3 1 64, stop 3 1 66, fast forward 

20 3 1 68, forward playback 3 1 70, single step forward 3 1 72. 

2 1 [1284] Single step backward 3 1 60 and single step forward 3 1 72 step one frame 

22 backward and forward, respectively. Backward playback 3162 and forward playback 

23 3 170 playback the images at a temporally realistic speed backward and forward, 
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1 respectively. Fast rewind 3 1 64 and fast forward 3 1 68 playback the images at a fast rate 

2 backward and forward, respectively. Fast forward 3168 and fast rewind 3 164 may be 

3 replaced with or m£iy be provided in addition to a variable speed rewind or a variable 

4 speed forward, respectively. Video controls 3 1 62-3 1 72 may be placed under cine tab 

5 3 1 04 or may be placed anywhere else on the screen. Other sets of icons may be used 

6 instead of or in addition to the ones displayed in FIG. 3 1 C. The cine control icons (e.g., 

7 video controls 3 1 62-3 1 72) may be selected and arranged so that they are easy navigate 

8 through and select via buttons 2016 or direction buttons and/or other buttons of keyboard 

9 1904 and/or buttons 2016 and direction buttons and/or other buttons of keyboard 1904 

10 may directly control how ultrasound system 100 steps through and/or plays back the 

1 1 frames. 

12 [1285] . FIG. 32 shows an example of a full screen image 3200 having back tab 3202, 

13 which brings back the sub-panel 2308 (FIG. 23) or 3302 (FIG. 33, below) depending 

14 upon which was the previous control panel. 

15 [1286] hi order to minimize user interactions the hide control tab 2410 of FIG. 24 

1 6 allows the user to directly switch to an imaging mode, where the image occupies the full 

17 screen as in FIG. 32, using full screen mode 618. Full screen mode 618 may show the 

1 8 user a bigger image, where the details are clearer than other viewing modes. 

19 [1287] FIG. 33 shows an example of a view 3300 including an annotation control 

20 panel 3302 having annotate select tab 3316 selected showing a list tab 3304, text tab 

21 3306, body markers tab 3308, indicators tab 33.10, voice tab 3312, and back tab 3314. 

22 [1288] List tab 3304 may bring the ultrasound system 100 to a list of user options, for 

23 . example, which may include a list of predefined annotations. An item in the list can be 
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1 selected by using up arrow 2124, down arrow 2120, left arrow 2122, right arrow 2118, 

2 select or enter button 21 14, direction and enter buttons of keyboard 1904, . a stylus, and/or 

3 speaking the item into the microphone, for example. The system may recognize words 

4 and automatically select the appropriate item. Ahematively, the system may present the 

5 item to the user in alphabetical order or labeled with letter and/or numbers. The user may 

6 then pronounce one or more letters and/or numbers, and ultrasound systems 100 

7 ' automatically searches the list for all armotations starting with that letter, number, or 

8 sequence of letters and/or numbers. Ultrasound system 100 then presents the items found 

9 to the user in alphabetical and/or numerical order. Text tab 3306 allows the user to enter 

10 . text onto the image by using either keyboard 1904, virtual keyboard 2800, voice input, 

1 1 and/or the free hand character recognition. . In an embodiment, the text can be moved 

12 anywhere on the image by dragging and dropping. Body markers tab 3308 gives the user 

13 a list of icons representing various body parts that can be placed on the image. Indicators 

14 tab 3310 is used to indicate the diagnosis of the patient. Voice tab 3312 is used to attach 

15 a voice message to the image. Back tab 3314 brings the ultrasound system 100 back to 

16 the previous view. 

17 [1289] FIG. 34 shows an example of a view 3400 including an annotation list 3402. 

18 As an example, annotation list 3402 of FIG. 34 is a list of body markers for aii OB/GYN, 

19 but could be focused differently for another user.and/or is just one view of several, each 

20 for a different type of examination, measurement, and/or user. Annotation list 3402 

21 includes an apical 4 marker 3404, uterus marker 3406, left breast body marker 3408, right 

22 breast body marker 3410, short axis marker 3412, right carotid marker 3414, supine 
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1 marker 3416, and thyroid marker 3418, for example. View 3400 also has a back tab 

2 3420. 

3 [1290] Annotation list 3402 can be used to select a body part marker, for example 

4 thyroid marker 3418, which appears on the image. The body part marker can be moved 

5 by dragging and dropping using a cursor arrow, for example. Back tab 3420 brings the 

6 ultrasound system 100 back to the previous view. Body markers can be static and/or, 

7 animated graphical objects. For example, an animated body marker can be used to 

8 represent more clearly what is the relative portion of the body being imaged by the 

9 ultrasound transducer. 

10 [1291] FIG. 35 shows a view 3500 of a handheld ultrasound system having a 

1 1 windows based GUI having control area #1 3502, image area #1 3504 , control area #2 

12 3506, and image area #2 3508. Control area #1 3502 and image area #1 3504 are 

13 attached to one another, while control area #2 3506 and image area #2 3508 are detached. 

14 In this embodiment the user can attach and detach the image areas and control panels and 

15 retile the screen as desired. Image area #1 3504 may contain a B-mode type image, while 

16 image area #2 3508 may contain a patient information view similar to view 2734. 

17 Additionally, image area #1 3504 or any other image area may be divided into a data area 

18 3510 containing data such as patient information and a picture area 3512 containing 

19 ultrasound images and/or plots. The screen can be tiled to view two image areas 

20 simultaneously, for example. The windows can be moved by dragging and dropping 

2 1 them with a cursor. 

22 [1292] Although many of the embodiments of the GUI 208 and of the operation of 

23 ultrasound system 100 were described in conjunction with the embodiment of FIGs. 20 
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1 and 21, the embodiment of FIG. 19 can also be used for the same embodiments described 

2 in conjunction with FIGs. 20 and 21. 

3 [1293J Although each of the modes 602-618 of image mode selection mode 308 is 

4 depicted as containing a different set of modes, any mode of contained within any of 

5 modes 608 could be used within any of the other of modes 602-61 8. 

6 [1294] Although the invention has been described with reference to specific 

7 embodiments, it will be understood by those skilled in the art that various changes may 

8 be made and equivalents may be substituted for elements thereof without departing fi-pm 

9 the true spirit and scope of the inventiori. In addition, modifications may be made 
iO without departing fi"om the essential teachings of the invention. 
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